Apr 13 17:41:35 user nova-compute[71354]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 17:41:38 user nova-compute[71354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71354) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71354) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71354) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 17:41:38 user nova-compute[71354]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:41:38 user nova-compute[71354]: INFO nova.virt.driver [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 17:41:38 user nova-compute[71354]: INFO nova.compute.provider_config [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Acquiring lock "singleton_lock" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Acquired lock "singleton_lock" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Releasing lock "singleton_lock" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Full set of CONF: {{(pid=71354) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ******************************************************************************** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Configuration options gathered from: {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ================================================================================ {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] allow_resize_to_same_host      = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] arq_binding_timeout            = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] backdoor_port                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] backdoor_socket                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] block_device_allocate_retries  = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] block_device_allocate_retries_interval = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cert                           = self.pem {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute_monitors               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] config_dir                     = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] config_drive_format            = iso9660 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] config_source                  = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] console_host                   = user {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] control_exchange               = nova {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cpu_allocation_ratio           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] daemon                         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] debug                          = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] default_access_ip_network_name = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] default_availability_zone      = nova {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] default_ephemeral_format       = ext4 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] default_schedule_zone          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] disk_allocation_ratio          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] enable_new_services            = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] enabled_ssl_apis               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] flat_injected                  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] force_config_drive             = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] force_raw_images               = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] graceful_shutdown_timeout      = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] heal_instance_info_cache_interval = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] host                           = user {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_build_timeout         = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_delete_interval       = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_name_template         = instance-%08x {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_usage_audit           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_usage_audit_period    = month {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] internal_service_availability_zone = internal {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] key                            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] live_migration_retry_count     = 30 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_config_append              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_dir                        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_file                       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_options                    = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_rotate_interval            = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_rotate_interval_type       = days {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] log_rotation_type              = none {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] long_rpc_timeout               = 1800 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_concurrent_builds          = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_concurrent_live_migrations = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_concurrent_snapshots       = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_local_block_devices        = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_logfile_count              = 30 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] max_logfile_size_mb            = 200 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] maximum_instance_delete_attempts = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metadata_listen                = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metadata_listen_port           = 8775 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metadata_workers               = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] migrate_max_retries            = -1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] mkisofs_cmd                    = genisoimage {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] my_ip                          = 10.0.0.210 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] network_allocate_retries       = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] osapi_compute_listen_port      = 8774 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] osapi_compute_unique_server_name_scope =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] osapi_compute_workers          = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] password_length                = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] periodic_enable                = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] periodic_fuzzy_delay           = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] pointer_model                  = ps2mouse {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] preallocate_images             = none {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] publish_errors                 = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] pybasedir                      = /opt/stack/nova {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ram_allocation_ratio           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rate_limit_burst               = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rate_limit_except_level        = CRITICAL {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rate_limit_interval            = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reboot_timeout                 = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reclaim_instance_interval      = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] record                         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reimage_timeout_per_gb         = 20 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] report_interval                = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rescue_timeout                 = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reserved_host_cpus             = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reserved_host_disk_mb          = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reserved_host_memory_mb        = 512 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] reserved_huge_pages            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] resize_confirm_window          = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] resize_fs_using_block_device   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] resume_guests_state_on_host_boot = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rpc_response_timeout           = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] run_external_periodic_tasks    = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] running_deleted_instance_action = reap {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] running_deleted_instance_timeout = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler_instance_sync_interval = 120 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_down_time              = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] servicegroup_driver            = db {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] shelved_offload_time           = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] shelved_poll_interval          = 3600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] shutdown_timeout               = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] source_is_ipv6                 = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ssl_only                       = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] state_path                     = /opt/stack/data/nova {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] sync_power_state_interval      = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] sync_power_state_pool_size     = 1000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] syslog_log_facility            = LOG_USER {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] tempdir                        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] timeout_nbd                    = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] transport_url                  = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] update_resources_interval      = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_cow_images                 = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_eventlog                   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_journal                    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_json                       = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_rootwrap_daemon            = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_stderr                     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] use_syslog                     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vcpu_pin_set                   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plugging_is_fatal          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plugging_timeout           = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] virt_mkfs                      = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] volume_usage_poll_interval     = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] watch_log_file                 = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] web                            = /usr/share/spice-html5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.auth_strategy              = keystone {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.compute_link_prefix        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.dhcp_domain                = novalocal {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.enable_instance_password   = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.glance_link_prefix         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.instance_list_per_project_cells = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.list_records_by_skipping_down_cells = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.local_metadata_per_cell    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.max_limit                  = 1000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.metadata_cache_expiration  = 15 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.neutron_default_tenant_id  = default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.use_forwarded_for          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.use_neutron_default_nets   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_dynamic_targets = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_jsonfile_path   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.backend_argument         = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.config_prefix            = cache.oslo {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.dead_timeout             = 60.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.debug_cache_backend      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.enable_retry_client      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.enable_socket_keepalive  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.enabled                  = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.expiration_time          = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_dead_retry      = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_password        =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_sasl_enabled    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.memcache_username        =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.proxies                  = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.retry_attempts           = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.retry_delay              = 0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.socket_keepalive_count   = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.socket_keepalive_idle    = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.socket_keepalive_interval = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.tls_allowed_ciphers      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.tls_cafile               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.tls_certfile             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.tls_enabled              = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cache.tls_keyfile              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.auth_section            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.auth_type               = password {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.cafile                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.certfile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.collect_timing          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.cross_az_attach         = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.debug                   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.endpoint_template       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.http_retries            = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.insecure                = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.keyfile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.os_region_name          = RegionOne {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.split_loggers           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cinder.timeout                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.cpu_dedicated_set      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.cpu_shared_set         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.image_type_exclude_list = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.resource_provider_association_refresh = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.shutdown_retry_interval = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] conductor.workers              = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] console.allowed_origins        = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] console.ssl_ciphers            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] console.ssl_minimum_version    = default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] consoleauth.token_ttl          = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.cafile                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.certfile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.collect_timing          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.connect_retries         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.connect_retry_delay     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.endpoint_override       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.insecure                = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.keyfile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.max_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.min_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.region_name             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.service_name            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.service_type            = accelerator {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.split_loggers           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.status_code_retries     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.timeout                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] cyborg.version                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.backend               = sqlalchemy {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.connection            = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.connection_debug      = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.connection_parameters =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.connection_recycle_time = 3600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.connection_trace      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.db_inc_retry_interval = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.db_max_retries        = 20 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.db_max_retry_interval = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.db_retry_interval     = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.max_overflow          = 50 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.max_pool_size         = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.max_retries           = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.mysql_enable_ndb      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.pool_timeout          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.retry_interval        = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.slave_connection      = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] database.sqlite_synchronous    = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.backend           = sqlalchemy {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.connection        = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.connection_debug  = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.connection_parameters =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.connection_recycle_time = 3600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.connection_trace  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.db_inc_retry_interval = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.db_max_retries    = 20 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.db_max_retry_interval = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.db_retry_interval = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.max_overflow      = 50 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.max_pool_size     = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.max_retries       = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.mysql_enable_ndb  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.pool_timeout      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.retry_interval    = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.slave_connection  = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] api_database.sqlite_synchronous = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] devices.enabled_mdev_types     = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ephemeral_storage_encryption.enabled = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.api_servers             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.cafile                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.certfile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.collect_timing          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.connect_retries         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.connect_retry_delay     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.debug                   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.default_trusted_certificate_ids = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.enable_certificate_validation = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.enable_rbd_download     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.endpoint_override       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.insecure                = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.keyfile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.max_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.min_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.num_retries             = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.rbd_ceph_conf           =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.rbd_connect_timeout     = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.rbd_pool                =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.rbd_user                =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.region_name             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.service_name            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.service_type            = image {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.split_loggers           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.status_code_retries     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.timeout                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.verify_glance_signatures = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] glance.version                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] guestfs.debug                  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.config_drive_cdrom      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.config_drive_inject_password = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.enable_remotefx         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.instances_path_share    =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.limit_cpu_features      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.use_multipath_io        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.vswitch_name            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] mks.enabled                    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.manager_interval   = 2400 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.precache_concurrency = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.remove_unused_base_images = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] image_cache.subdirectory_name  = _base {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.api_max_retries         = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.api_retry_interval      = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.auth_section            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.auth_type               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.cafile                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.certfile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.collect_timing          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.connect_retries         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.connect_retry_delay     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.endpoint_override       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.insecure                = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.keyfile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.max_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.min_version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.partition_key           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.peer_list               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.region_name             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.serial_console_state_timeout = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.service_name            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.service_type            = baremetal {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.split_loggers           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.status_code_retries     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.timeout                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ironic.version                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] key_manager.fixed_key          = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.barbican_api_version  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.barbican_endpoint     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.barbican_endpoint_type = public {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.barbican_region_name  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.cafile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.certfile              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.collect_timing        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.insecure              = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.keyfile               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.number_of_retries     = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.retry_delay           = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.send_service_user_token = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.split_loggers         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.timeout               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.verify_ssl            = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican.verify_ssl_path       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.auth_section = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.auth_type = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.cafile   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.certfile = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.collect_timing = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.insecure = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.keyfile  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.split_loggers = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] barbican_service_user.timeout  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.approle_role_id          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.approle_secret_id        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.cafile                   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.certfile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.collect_timing           = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.insecure                 = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.keyfile                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.kv_mountpoint            = secret {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.kv_version               = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.namespace                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.root_token_id            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.split_loggers            = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.ssl_ca_crt_file          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.timeout                  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.use_ssl                  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.cafile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.certfile              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.collect_timing        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.connect_retries       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.connect_retry_delay   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.endpoint_override     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.insecure              = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.keyfile               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.max_version           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.min_version           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.region_name           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.service_name          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.service_type          = identity {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.split_loggers         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.status_code_retries   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.timeout               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] keystone.version               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.connection_uri         =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_mode               = custom {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: WARNING oslo_config.cfg [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_power_governor_high = performance {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_power_management   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.device_detach_attempts = 8 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.device_detach_timeout  = 20 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.disk_cachemodes        = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.disk_prefix            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.enabled_perf_events    = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.file_backed_memory     = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.gid_maps               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.hw_disk_discard        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.hw_machine_type        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_rbd_pool        = rbd {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_type            = default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.images_volume_group    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.inject_key             = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.inject_partition       = -2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.inject_password        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.iscsi_iface            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.iser_use_multipath     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_downtime = 500 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_inbound_addr = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_scheme  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_timeout_action = abort {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_tunnelled = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: WARNING oslo_config.cfg [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 17:41:38 user nova-compute[71354]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 17:41:38 user nova-compute[71354]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 17:41:38 user nova-compute[71354]: and ``live_migration_inbound_addr`` respectively.
Apr 13 17:41:38 user nova-compute[71354]: ).  Its value may be silently ignored in the future.
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.live_migration_with_native_tls = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.max_queues             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.nfs_mount_options      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_pcie_ports         = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.pmem_namespaces        = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.quobyte_client_cfg     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rbd_secret_uuid        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rbd_user               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rescue_image_id        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rescue_kernel_id       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.rx_queue_size          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.smbfs_mount_options    =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.snapshot_compression   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.snapshot_image_format  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.sparse_logical_volumes = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.swtpm_enabled          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.swtpm_group            = tss {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.swtpm_user             = tss {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.sysinfo_serial         = unique {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.tx_queue_size          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.uid_maps               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.use_virtio_for_bridges = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.virt_type              = kvm {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.volume_clear           = zero {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.volume_clear_size      = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.volume_use_multipath   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_cache_path   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.auth_section           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.auth_type              = password {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.cafile                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.certfile               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.collect_timing         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.connect_retries        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.connect_retry_delay    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.default_floating_pool  = public {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.endpoint_override      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.extension_sync_interval = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.http_retries           = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.insecure               = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.keyfile                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.max_version            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.min_version            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.ovs_bridge             = br-int {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.physnets               = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.region_name            = RegionOne {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.service_metadata_proxy = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.service_name           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.service_type           = network {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.split_loggers          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.status_code_retries    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.timeout                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] neutron.version                = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] notifications.bdms_in_notifications = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] notifications.default_level    = INFO {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] notifications.notification_format = unversioned {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] notifications.notify_on_state_change = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] pci.alias                      = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] pci.device_spec                = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] pci.report_in_placement        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.auth_section         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.auth_type            = password {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.cafile               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.certfile             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.collect_timing       = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.connect_retries      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.connect_retry_delay  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.default_domain_id    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.default_domain_name  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.domain_id            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.domain_name          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.endpoint_override    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.insecure             = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.keyfile              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.max_version          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.min_version          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.password             = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.project_domain_id    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.project_domain_name  = Default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.project_id           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.project_name         = service {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.region_name          = RegionOne {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.service_name         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.service_type         = placement {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.split_loggers        = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.status_code_retries  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.system_scope         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.timeout              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.trust_id             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.user_domain_id       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.user_domain_name     = Default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.user_id              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.username             = placement {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] placement.version              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.cores                    = 20 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.count_usage_from_placement = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.injected_file_content_bytes = 10240 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.injected_file_path_length = 255 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.injected_files           = 5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.instances                = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.key_pairs                = 100 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.metadata_items           = 128 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.ram                      = 51200 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.recheck_quota            = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.server_group_members     = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] quota.server_groups            = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rdp.enabled                    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.image_metadata_prefilter = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.max_attempts         = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.max_placement_results = 1000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] scheduler.workers              = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.host_subset_size = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.isolated_hosts = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.isolated_images = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.pci_in_placement = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.track_instance_changes = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metrics.required               = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metrics.weight_multiplier      = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:38 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] metrics.weight_setting         = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.enabled         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.port_range      = 10000:20000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] serial_console.serialproxy_port = 6083 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.auth_section      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.auth_type         = password {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.cafile            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.certfile          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.collect_timing    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.insecure          = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.keyfile           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.send_service_user_token = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.split_loggers     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] service_user.timeout           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.agent_enabled            = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.enabled                  = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.html5proxy_port          = 6082 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.image_compression        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.jpeg_compression         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.playback_compression     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.server_listen            = 127.0.0.1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.streaming_mode           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] spice.zlib_compression         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] upgrade_levels.baseapi         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] upgrade_levels.cert            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] upgrade_levels.compute         = auto {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] upgrade_levels.conductor       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] upgrade_levels.scheduler       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.cafile = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.certfile = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.insecure = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vendordata_dynamic_auth.timeout = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.api_retry_count         = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.ca_file                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.cache_prefix            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.cluster_name            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.connection_pool_size    = 10 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.console_delay_seconds   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.datastore_regex         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.host_ip                 = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.host_password           = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.host_port               = 443 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.host_username           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.insecure                = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.integration_bridge      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.maximum_objects         = 100 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.pbm_default_policy      = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.pbm_enabled             = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.pbm_wsdl_location       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.serial_port_proxy_uri   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.serial_port_service_uri = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.task_poll_interval      = 0.5 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.use_linked_clone        = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.vnc_keymap              = en-us {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.vnc_port                = 5900 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vmware.vnc_port_total          = 10000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.auth_schemes               = ['none'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.enabled                    = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.novncproxy_port            = 6080 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.vencrypt_ca_certs          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.vencrypt_client_cert       = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vnc.vencrypt_client_key        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.disable_rootwrap   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.enable_numa_live_migration = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.libvirt_disable_apic = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.client_socket_timeout     = 900 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.default_pool_size         = 1000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.keep_alive                = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.max_header_line           = 16384 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.ssl_ca_file               = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.ssl_cert_file             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.ssl_key_file              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.tcp_keepidle              = 600 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] zvm.ca_file                    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] zvm.cloud_connector_url        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] zvm.reachable_timeout          = 300 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.enforce_new_defaults = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.enforce_scope      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.policy_default_rule = default {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.connection_string     = messaging:// {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.enabled               = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.es_doc_type           = notification {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.es_scroll_size        = 10000 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.es_scroll_time        = 2m {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.filter_error_trace    = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.sentinel_service_name = mymaster {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.socket_timeout        = 0.1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] profiler.trace_sqlalchemy      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] remote_debug.host              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] remote_debug.port              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.auth_section        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.auth_type           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.cafile              = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.certfile            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.collect_timing      = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.connect_retries     = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.connect_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.endpoint_id         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.endpoint_override   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.insecure            = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.keyfile             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.max_version         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.min_version         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.region_name         = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.service_name        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.service_type        = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.split_loggers       = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.status_code_retries = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.status_code_retry_delay = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.timeout             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.valid_interfaces    = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_limit.version             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_reports.file_event_handler = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] oslo_reports.log_dir           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.group  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] vif_plug_ovs_privileged.user   = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.isolate_vif         = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] os_brick.lock_path             = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.capabilities   = [21] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.group          = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.helper_command = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] privsep_osbrick.user           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.group           = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.helper_command  = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] nova_sys_admin.user            = None {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG oslo_service.service [None req-db08b5ba-8647-481b-a0e8-69a7b75679b8 None None] ******************************************************************************** {{(pid=71354) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 17:41:39 user nova-compute[71354]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Starting native event thread {{(pid=71354) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Starting green dispatch thread {{(pid=71354) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Starting connection event dispatch thread {{(pid=71354) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Connecting to libvirt: qemu:///system {{(pid=71354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f50d65ba500> {{(pid=71354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f50d65ba500> {{(pid=71354) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 17:41:39 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Connection event '1' reason 'None'
Apr 13 17:41:39 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 17:41:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.mount [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Initialising _HostMountState generation 0 {{(pid=71354) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 17:41:46 user nova-compute[71354]: INFO nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host capabilities <capabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <host>
Apr 13 17:41:46 user nova-compute[71354]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 17:41:46 user nova-compute[71354]:     <cpu>
Apr 13 17:41:46 user nova-compute[71354]:       <arch>x86_64</arch>
Apr 13 17:41:46 user nova-compute[71354]:       <model>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <microcode version='1070'/>
Apr 13 17:41:46 user nova-compute[71354]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='osxsave'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='invtsc'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='rsba'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 17:41:46 user nova-compute[71354]:       <pages unit='KiB' size='4'/>
Apr 13 17:41:46 user nova-compute[71354]:       <pages unit='KiB' size='2048'/>
Apr 13 17:41:46 user nova-compute[71354]:     </cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <power_management>
Apr 13 17:41:46 user nova-compute[71354]:       <suspend_mem/>
Apr 13 17:41:46 user nova-compute[71354]:       <suspend_disk/>
Apr 13 17:41:46 user nova-compute[71354]:       <suspend_hybrid/>
Apr 13 17:41:46 user nova-compute[71354]:     </power_management>
Apr 13 17:41:46 user nova-compute[71354]:     <iommu support='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <migration_features>
Apr 13 17:41:46 user nova-compute[71354]:       <live/>
Apr 13 17:41:46 user nova-compute[71354]:       <uri_transports>
Apr 13 17:41:46 user nova-compute[71354]:         <uri_transport>tcp</uri_transport>
Apr 13 17:41:46 user nova-compute[71354]:         <uri_transport>rdma</uri_transport>
Apr 13 17:41:46 user nova-compute[71354]:       </uri_transports>
Apr 13 17:41:46 user nova-compute[71354]:     </migration_features>
Apr 13 17:41:46 user nova-compute[71354]:     <topology>
Apr 13 17:41:46 user nova-compute[71354]:       <cells num='2'>
Apr 13 17:41:46 user nova-compute[71354]:         <cell id='0'>
Apr 13 17:41:46 user nova-compute[71354]:           <memory unit='KiB'>8189224</memory>
Apr 13 17:41:46 user nova-compute[71354]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 13 17:41:46 user nova-compute[71354]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 17:41:46 user nova-compute[71354]:           <distances>
Apr 13 17:41:46 user nova-compute[71354]:             <sibling id='0' value='10'/>
Apr 13 17:41:46 user nova-compute[71354]:             <sibling id='1' value='20'/>
Apr 13 17:41:46 user nova-compute[71354]:           </distances>
Apr 13 17:41:46 user nova-compute[71354]:           <cpus num='6'>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 17:41:46 user nova-compute[71354]:           </cpus>
Apr 13 17:41:46 user nova-compute[71354]:         </cell>
Apr 13 17:41:46 user nova-compute[71354]:         <cell id='1'>
Apr 13 17:41:46 user nova-compute[71354]:           <memory unit='KiB'>8218764</memory>
Apr 13 17:41:46 user nova-compute[71354]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 13 17:41:46 user nova-compute[71354]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 17:41:46 user nova-compute[71354]:           <distances>
Apr 13 17:41:46 user nova-compute[71354]:             <sibling id='0' value='20'/>
Apr 13 17:41:46 user nova-compute[71354]:             <sibling id='1' value='10'/>
Apr 13 17:41:46 user nova-compute[71354]:           </distances>
Apr 13 17:41:46 user nova-compute[71354]:           <cpus num='6'>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 17:41:46 user nova-compute[71354]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 17:41:46 user nova-compute[71354]:           </cpus>
Apr 13 17:41:46 user nova-compute[71354]:         </cell>
Apr 13 17:41:46 user nova-compute[71354]:       </cells>
Apr 13 17:41:46 user nova-compute[71354]:     </topology>
Apr 13 17:41:46 user nova-compute[71354]:     <cache>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 17:41:46 user nova-compute[71354]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 17:41:46 user nova-compute[71354]:     </cache>
Apr 13 17:41:46 user nova-compute[71354]:     <secmodel>
Apr 13 17:41:46 user nova-compute[71354]:       <model>apparmor</model>
Apr 13 17:41:46 user nova-compute[71354]:       <doi>0</doi>
Apr 13 17:41:46 user nova-compute[71354]:     </secmodel>
Apr 13 17:41:46 user nova-compute[71354]:     <secmodel>
Apr 13 17:41:46 user nova-compute[71354]:       <model>dac</model>
Apr 13 17:41:46 user nova-compute[71354]:       <doi>0</doi>
Apr 13 17:41:46 user nova-compute[71354]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 17:41:46 user nova-compute[71354]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 17:41:46 user nova-compute[71354]:     </secmodel>
Apr 13 17:41:46 user nova-compute[71354]:   </host>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='alpha'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>clipper</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='armv6l'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>spitz</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>nuri</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>kzm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>z2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>tosa</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n810</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>terrier</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>midway</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>microbit</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>verdex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>highbank</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>akita</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>connex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>collie</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='armv7l'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>spitz</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>nuri</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>kzm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>z2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>tosa</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n810</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>terrier</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>midway</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>microbit</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>verdex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>highbank</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>akita</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>connex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>collie</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='aarch64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>spitz</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>nuri</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>kzm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>z2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>tosa</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n810</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>n800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>terrier</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>midway</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>microbit</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>verdex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>highbank</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>akita</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>connex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>collie</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <acpi default='on' toggle='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='cris'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='i686'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>isapc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>microvm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='kvm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <pae/>
Apr 13 17:41:46 user nova-compute[71354]:       <nonpae/>
Apr 13 17:41:46 user nova-compute[71354]:       <acpi default='on' toggle='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:       <apic default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='m68k'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>an5206</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>q800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='microblaze'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='microblazeel'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='mips'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>malta</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='mipsel'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>malta</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='mips64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>malta</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>pica61</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>magnum</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='mips64el'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>malta</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>pica61</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>magnum</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='16'>boston</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='ppc'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mac99</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>40p</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>taihu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='ppc64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>taihu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>40p</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mac99</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='ppc64le'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>taihu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>40p</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>mac99</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='riscv32'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='8'>spike</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='8'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='riscv64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='8'>spike</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='8'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='s390x'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='sh4'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>shix</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>r2d</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='sh4eb'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>shix</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>r2d</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='sparc'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>LX</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='sparc64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>niagara</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='x86_64'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>64</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='1'>isapc</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>microvm</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='kvm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <acpi default='on' toggle='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:       <apic default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='xtensa'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>sim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>kc705</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ml605</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx200</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx60</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]:   <guest>
Apr 13 17:41:46 user nova-compute[71354]:     <os_type>hvm</os_type>
Apr 13 17:41:46 user nova-compute[71354]:     <arch name='xtensaeb'>
Apr 13 17:41:46 user nova-compute[71354]:       <wordsize>32</wordsize>
Apr 13 17:41:46 user nova-compute[71354]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='4'>sim</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>kc705</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ml605</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>virt</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx200</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>lx60</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 17:41:46 user nova-compute[71354]:       <domain type='qemu'/>
Apr 13 17:41:46 user nova-compute[71354]:     </arch>
Apr 13 17:41:46 user nova-compute[71354]:     <features>
Apr 13 17:41:46 user nova-compute[71354]:       <cpuselection/>
Apr 13 17:41:46 user nova-compute[71354]:       <deviceboot/>
Apr 13 17:41:46 user nova-compute[71354]:       <disksnapshot default='on' toggle='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     </features>
Apr 13 17:41:46 user nova-compute[71354]:   </guest>
Apr 13 17:41:46 user nova-compute[71354]: </capabilities>
Apr 13 17:41:46 user nova-compute[71354]: 
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-q35-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>i686</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='288'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'/>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='lm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-i440fx-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>i686</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='255'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'/>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='lm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ide</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-i440fx-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>i686</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='255'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'/>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='lm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ide</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-q35-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>i686</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='288'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'/>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='lm'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-q35-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>x86_64</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='288'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>efi</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='invtsc'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='rsba'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-i440fx-6.2</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>x86_64</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='255'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>efi</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='invtsc'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='rsba'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ide</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-i440fx-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>x86_64</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='255'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>efi</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='invtsc'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='rsba'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ide</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 17:41:46 user nova-compute[71354]: <domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 17:41:46 user nova-compute[71354]:   <domain>kvm</domain>
Apr 13 17:41:46 user nova-compute[71354]:   <machine>pc-q35-jammy</machine>
Apr 13 17:41:46 user nova-compute[71354]:   <arch>x86_64</arch>
Apr 13 17:41:46 user nova-compute[71354]:   <vcpu max='288'/>
Apr 13 17:41:46 user nova-compute[71354]:   <iothreads supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:   <os supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='firmware'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>efi</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:     <loader supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>rom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pflash</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='readonly'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='secure'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>yes</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>no</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </loader>
Apr 13 17:41:46 user nova-compute[71354]:   </os>
Apr 13 17:41:46 user nova-compute[71354]:   <cpu>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-passthrough' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='hostPassthroughMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='maximum' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='maximumMigratable'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>on</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>off</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='host-model' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <vendor>Intel</vendor>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ss'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='vmx'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pcid'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='hypervisor'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arat'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='umip'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='md-clear'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='invtsc'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibpb'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='ibrs'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-stibp'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='rsba'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='erms'/>
Apr 13 17:41:46 user nova-compute[71354]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:     <mode name='custom' supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>qemu64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>qemu32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>phenom</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>pentium</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>n270</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm64</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>kvm32</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>coreduo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>core2duo</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>athlon</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Westmere</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Snowridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Skylake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>SandyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Penryn</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G5</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G4</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G3</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Opteron_G2</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Opteron_G1</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>IvyBridge</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Icelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Haswell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Rome</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-Milan</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>EPYC</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Dhyana</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cooperlake</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>Conroe</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='no'>Broadwell</model>
Apr 13 17:41:46 user nova-compute[71354]:       <model usable='yes'>486</model>
Apr 13 17:41:46 user nova-compute[71354]:     </mode>
Apr 13 17:41:46 user nova-compute[71354]:   </cpu>
Apr 13 17:41:46 user nova-compute[71354]:   <memoryBacking supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:     <enum name='sourceType'>
Apr 13 17:41:46 user nova-compute[71354]:       <value>file</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>anonymous</value>
Apr 13 17:41:46 user nova-compute[71354]:       <value>memfd</value>
Apr 13 17:41:46 user nova-compute[71354]:     </enum>
Apr 13 17:41:46 user nova-compute[71354]:   </memoryBacking>
Apr 13 17:41:46 user nova-compute[71354]:   <devices>
Apr 13 17:41:46 user nova-compute[71354]:     <disk supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='diskDevice'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>disk</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cdrom</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>floppy</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>lun</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='bus'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>fdc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sata</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </disk>
Apr 13 17:41:46 user nova-compute[71354]:     <graphics supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='type'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>sdl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vnc</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>spice</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egl-headless</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </graphics>
Apr 13 17:41:46 user nova-compute[71354]:     <video supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='modelType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>cirrus</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>vmvga</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>qxl</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>none</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>bochs</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>ramfb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </video>
Apr 13 17:41:46 user nova-compute[71354]:     <hostdev supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='mode'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>subsystem</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='startupPolicy'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>default</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>mandatory</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>requisite</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>optional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='subsysType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>usb</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>pci</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>scsi</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='capsType'/>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='pciBackend'/>
Apr 13 17:41:46 user nova-compute[71354]:     </hostdev>
Apr 13 17:41:46 user nova-compute[71354]:     <rng supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtio-non-transitional</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>random</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>egd</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>builtin</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </rng>
Apr 13 17:41:46 user nova-compute[71354]:     <filesystem supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='driverType'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>path</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>handle</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>virtiofs</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </filesystem>
Apr 13 17:41:46 user nova-compute[71354]:     <tpm supported='yes'>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='model'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-tis</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>tpm-crb</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:       <enum name='backendModel'>
Apr 13 17:41:46 user nova-compute[71354]:         <value>passthrough</value>
Apr 13 17:41:46 user nova-compute[71354]:         <value>emulator</value>
Apr 13 17:41:46 user nova-compute[71354]:       </enum>
Apr 13 17:41:46 user nova-compute[71354]:     </tpm>
Apr 13 17:41:46 user nova-compute[71354]:   </devices>
Apr 13 17:41:46 user nova-compute[71354]:   <features>
Apr 13 17:41:46 user nova-compute[71354]:     <gic supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:     <vmcoreinfo supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <genid supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backingStoreInput supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <backup supported='yes'/>
Apr 13 17:41:46 user nova-compute[71354]:     <sev supported='no'/>
Apr 13 17:41:46 user nova-compute[71354]:   </features>
Apr 13 17:41:46 user nova-compute[71354]: </domainCapabilities>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71354) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71354) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Checking secure boot support for host arch (x86_64) {{(pid=71354) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 17:41:46 user nova-compute[71354]: INFO nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Secure Boot support detected
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] cpu compare xml: <cpu match="exact">
Apr 13 17:41:46 user nova-compute[71354]:   <model>Nehalem</model>
Apr 13 17:41:46 user nova-compute[71354]: </cpu>
Apr 13 17:41:46 user nova-compute[71354]:  {{(pid=71354) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 17:41:46 user nova-compute[71354]: INFO nova.virt.node [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Generated node identity 5ba64940-f5e9-4512-be6b-2626ffa78506
Apr 13 17:41:46 user nova-compute[71354]: INFO nova.virt.node [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Wrote node identity 5ba64940-f5e9-4512-be6b-2626ffa78506 to /opt/stack/data/nova/compute_id
Apr 13 17:41:46 user nova-compute[71354]: WARNING nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Compute nodes ['5ba64940-f5e9-4512-be6b-2626ffa78506'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 17:41:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 17:41:46 user nova-compute[71354]: WARNING nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 17:41:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:41:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:41:47 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:41:47 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Hypervisor/Node resource view: name=user free_ram=10789MB free_disk=27.111244201660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:41:47 user nova-compute[71354]: WARNING nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] No compute node record for user:5ba64940-f5e9-4512-be6b-2626ffa78506: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5ba64940-f5e9-4512-be6b-2626ffa78506 could not be found.
Apr 13 17:41:47 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Compute node record created for user:user with uuid: 5ba64940-f5e9-4512-be6b-2626ffa78506
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:41:47 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [req-11c9c68a-4508-407e-a907-1019b7218d07] Created resource provider record via placement API for resource provider with UUID 5ba64940-f5e9-4512-be6b-2626ffa78506 and name user.
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71354) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 17:41:47 user nova-compute[71354]: INFO nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] kernel doesn't support AMD SEV
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Libvirt baseline CPU <cpu>
Apr 13 17:41:47 user nova-compute[71354]:   <arch>x86_64</arch>
Apr 13 17:41:47 user nova-compute[71354]:   <model>Nehalem</model>
Apr 13 17:41:47 user nova-compute[71354]:   <vendor>Intel</vendor>
Apr 13 17:41:47 user nova-compute[71354]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 17:41:47 user nova-compute[71354]: </cpu>
Apr 13 17:41:47 user nova-compute[71354]:  {{(pid=71354) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Updated inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Updating resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 generation from 0 to 1 during operation: update_inventory {{(pid=71354) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Updating resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 generation from 1 to 2 during operation: update_traits {{(pid=71354) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.service [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Creating RPC server for service compute {{(pid=71354) start /opt/stack/nova/nova/service.py:182}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.service [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Join ServiceGroup membership for this service compute {{(pid=71354) start /opt/stack/nova/nova/service.py:199}}
Apr 13 17:41:47 user nova-compute[71354]: DEBUG nova.servicegroup.drivers.db [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71354) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 17:42:30 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:30 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:42:38 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:42:39 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:42:39 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=10193MB free_disk=27.02503204345703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:42:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:43:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:43:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=10156MB free_disk=27.070816040039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:43:40 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:43:41 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:43:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:44:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:44:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=10157MB free_disk=26.847190856933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:44:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:44:41 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:44:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:45:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:45:40 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:45:40 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=9405MB free_disk=26.87006378173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:45:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:45:51 user nova-compute[71354]: INFO nova.compute.claims [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Claim successful on node user
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:45:51 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:45:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:45:52 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Creating image(s)
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "/opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "/opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.virt.images [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] c7f9966b-afb1-42f9-9999-e623e0bf219a was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.part /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG nova.policy [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '772b5f3399f247d191e0f32d386ecea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4d4b5316fa45838c82ce0a0cfbc3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.part /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.converted" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.931s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:53 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2vcdn855/privsep.sock']
Apr 13 17:45:53 user sudo[80070]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2vcdn855/privsep.sock
Apr 13 17:45:53 user sudo[80070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 17:45:55 user sudo[80070]: pam_unix(sudo:session): session closed for user root
Apr 13 17:45:55 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Spawned new privsep daemon via rootwrap
Apr 13 17:45:55 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 17:45:55 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 17:45:55 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 17:45:55 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80073
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.128s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk 1073741824" returned: 0 in 0.045s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Cannot resize image /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lazy-loading 'migration_context' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Ensure instance console log exists: /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:45:56 user nova-compute[71354]: INFO nova.compute.claims [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Claim successful on node user
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Successfully created port: cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:45:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:45:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Creating image(s)
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "/opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "/opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.118s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk 1073741824" returned: 0 in 0.048s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:45:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.policy [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.165s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Cannot resize image /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'migration_context' on Instance uuid bc89ac54-6844-45b9-8dac-c10d893b699b {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Ensure instance console log exists: /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:45:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:01 user nova-compute[71354]: INFO nova.compute.claims [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Claim successful on node user
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:01 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Successfully created port: 6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:01 user nova-compute[71354]: INFO nova.compute.claims [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Claim successful on node user
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:01 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating image(s)
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Successfully updated port: cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquired lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:01 user nova-compute[71354]: DEBUG nova.policy [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk 1073741824" returned: 0 in 0.050s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-changed-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Refreshing instance network info cache due to event network-changed-cb796c18-e5d5-45de-b1e9-07a5548b8a6e. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Acquiring lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.182s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Creating image(s)
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "/opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "/opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Cannot resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'migration_context' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Ensure instance console log exists: /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.policy [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75c1cf6ba73c4adb9124f14d78f4ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a40fa0611d54d5b8a35fcc469fc5361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk 1073741824" returned: 0 in 0.045s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.119s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Cannot resize image /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.objects.instance [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lazy-loading 'migration_context' on Instance uuid fd435a8f-372c-4aab-81b0-a1f76658b5b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Ensure instance console log exists: /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating instance_info_cache with network_info: [{"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Releasing lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Instance network_info: |[{"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Acquired lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Refreshing network info cache for port cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Start _get_guest_xml network_info=[{"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:03 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:03 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-448804682',display_name='tempest-DeleteServersTestJSON-server-448804682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-448804682',id=1,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f4d4b5316fa45838c82ce0a0cfbc3dc',ramdisk_id='',reservation_id='r-h4ankn5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-492033592',owner_user_name='tempest-DeleteServersTestJSON-492033592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:45:52Z,user_data=None,user_id='772b5f3399f247d191e0f32d386ecea6',uuid=bfcf221f-b53a-4e85-9743-ee10ab3c387c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converting VIF {"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.objects.instance [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lazy-loading 'pci_devices' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:03 user nova-compute[71354]:   <uuid>bfcf221f-b53a-4e85-9743-ee10ab3c387c</uuid>
Apr 13 17:46:03 user nova-compute[71354]:   <name>instance-00000001</name>
Apr 13 17:46:03 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:03 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:03 user nova-compute[71354]:   <metadata>
Apr 13 17:46:03 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:03 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:name>tempest-DeleteServersTestJSON-server-448804682</nova:name>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:03</nova:creationTime>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:03 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:03 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:user uuid="772b5f3399f247d191e0f32d386ecea6">tempest-DeleteServersTestJSON-492033592-project-member</nova:user>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:project uuid="3f4d4b5316fa45838c82ce0a0cfbc3dc">tempest-DeleteServersTestJSON-492033592</nova:project>
Apr 13 17:46:03 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:03 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:03 user nova-compute[71354]:         <nova:port uuid="cb796c18-e5d5-45de-b1e9-07a5548b8a6e">
Apr 13 17:46:03 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:46:03 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:03 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:03 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:03 user nova-compute[71354]:   </metadata>
Apr 13 17:46:03 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:03 user nova-compute[71354]:     <system>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="serial">bfcf221f-b53a-4e85-9743-ee10ab3c387c</entry>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="uuid">bfcf221f-b53a-4e85-9743-ee10ab3c387c</entry>
Apr 13 17:46:03 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:03 user nova-compute[71354]:     </system>
Apr 13 17:46:03 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:03 user nova-compute[71354]:   <os>
Apr 13 17:46:03 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:03 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:03 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:03 user nova-compute[71354]:   </os>
Apr 13 17:46:03 user nova-compute[71354]:   <features>
Apr 13 17:46:03 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:03 user nova-compute[71354]:     <apic/>
Apr 13 17:46:03 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:03 user nova-compute[71354]:   </features>
Apr 13 17:46:03 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:03 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:03 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:03 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:03 user nova-compute[71354]:   </clock>
Apr 13 17:46:03 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:03 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:03 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:03 user nova-compute[71354]:   </cpu>
Apr 13 17:46:03 user nova-compute[71354]:   <devices>
Apr 13 17:46:03 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:03 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:03 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk"/>
Apr 13 17:46:03 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:03 user nova-compute[71354]:     </disk>
Apr 13 17:46:03 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:03 user nova-compute[71354]:       <mac address="fa:16:3e:cb:ae:e6"/>
Apr 13 17:46:03 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:03 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:03 user nova-compute[71354]:       <target dev="tapcb796c18-e5"/>
Apr 13 17:46:03 user nova-compute[71354]:     </interface>
Apr 13 17:46:03 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:03 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/console.log" append="off"/>
Apr 13 17:46:03 user nova-compute[71354]:     </serial>
Apr 13 17:46:03 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:03 user nova-compute[71354]:     <video>
Apr 13 17:46:03 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:03 user nova-compute[71354]:     </video>
Apr 13 17:46:03 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:03 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:03 user nova-compute[71354]:     </rng>
Apr 13 17:46:03 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:03 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:03 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:03 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:03 user nova-compute[71354]:   </devices>
Apr 13 17:46:03 user nova-compute[71354]: </domain>
Apr 13 17:46:03 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-448804682',display_name='tempest-DeleteServersTestJSON-server-448804682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-448804682',id=1,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f4d4b5316fa45838c82ce0a0cfbc3dc',ramdisk_id='',reservation_id='r-h4ankn5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-492033592',owner_user_name='tempest-DeleteServersTestJSON-492033592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:45:52Z,user_data=None,user_id='772b5f3399f247d191e0f32d386ecea6',uuid=bfcf221f-b53a-4e85-9743-ee10ab3c387c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converting VIF {"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG os_vif [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Created schema index Interface.name {{(pid=71354) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Created schema index Port.name {{(pid=71354) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Created schema index Bridge.name {{(pid=71354) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [POLLOUT] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:03 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp49pyef8w/privsep.sock']
Apr 13 17:46:03 user sudo[80159]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp49pyef8w/privsep.sock
Apr 13 17:46:03 user sudo[80159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 17:46:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Successfully created port: 067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Successfully updated port: 6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquired lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-changed-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Refreshing instance network info cache due to event network-changed-6431e14a-e7e3-4cb5-9fe6-015c1debef03. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Acquiring lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updated VIF entry in instance network info cache for port cb796c18-e5d5-45de-b1e9-07a5548b8a6e. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating instance_info_cache with network_info: [{"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54a6a46f-48ed-4697-b356-4969033cb9df req-2c4b979d-d77f-427d-b472-1a846da2c2dc service nova] Releasing lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:05 user sudo[80159]: pam_unix(sudo:session): session closed for user root
Apr 13 17:46:05 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Spawned new privsep daemon via rootwrap
Apr 13 17:46:05 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 17:46:05 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 17:46:05 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 17:46:05 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80162
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb796c18-e5, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb796c18-e5, col_values=(('external_ids', {'iface-id': 'cb796c18-e5d5-45de-b1e9-07a5548b8a6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ae:e6', 'vm-uuid': 'bfcf221f-b53a-4e85-9743-ee10ab3c387c'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:05 user nova-compute[71354]: INFO os_vif [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5')
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] No VIF found with MAC fa:16:3e:cb:ae:e6, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Successfully created port: 9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Releasing lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Instance network_info: |[{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Acquired lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Refreshing network info cache for port 6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Start _get_guest_xml network_info=[{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:06 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:06 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743764397',display_name='tempest-ServersNegativeTestJSON-server-743764397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743764397',id=2,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-6ywzng84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:45:57Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=bc89ac54-6844-45b9-8dac-c10d893b699b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'pci_devices' on Instance uuid bc89ac54-6844-45b9-8dac-c10d893b699b {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:06 user nova-compute[71354]:   <uuid>bc89ac54-6844-45b9-8dac-c10d893b699b</uuid>
Apr 13 17:46:06 user nova-compute[71354]:   <name>instance-00000002</name>
Apr 13 17:46:06 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:06 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:06 user nova-compute[71354]:   <metadata>
Apr 13 17:46:06 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:06 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:name>tempest-ServersNegativeTestJSON-server-743764397</nova:name>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:06</nova:creationTime>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:06 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:06 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:user uuid="b33d4309055340a4b42df540ca62d59f">tempest-ServersNegativeTestJSON-238465742-project-member</nova:user>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:project uuid="b4fbca3daa10432c8abf5e8cc0dff050">tempest-ServersNegativeTestJSON-238465742</nova:project>
Apr 13 17:46:06 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:06 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:06 user nova-compute[71354]:         <nova:port uuid="6431e14a-e7e3-4cb5-9fe6-015c1debef03">
Apr 13 17:46:06 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:46:06 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:06 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:06 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:06 user nova-compute[71354]:   </metadata>
Apr 13 17:46:06 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:06 user nova-compute[71354]:     <system>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="serial">bc89ac54-6844-45b9-8dac-c10d893b699b</entry>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="uuid">bc89ac54-6844-45b9-8dac-c10d893b699b</entry>
Apr 13 17:46:06 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:06 user nova-compute[71354]:     </system>
Apr 13 17:46:06 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:06 user nova-compute[71354]:   <os>
Apr 13 17:46:06 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:06 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:06 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:06 user nova-compute[71354]:   </os>
Apr 13 17:46:06 user nova-compute[71354]:   <features>
Apr 13 17:46:06 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:06 user nova-compute[71354]:     <apic/>
Apr 13 17:46:06 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:06 user nova-compute[71354]:   </features>
Apr 13 17:46:06 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:06 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:06 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:06 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:06 user nova-compute[71354]:   </clock>
Apr 13 17:46:06 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:06 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:06 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:06 user nova-compute[71354]:   </cpu>
Apr 13 17:46:06 user nova-compute[71354]:   <devices>
Apr 13 17:46:06 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:06 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:06 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk"/>
Apr 13 17:46:06 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:06 user nova-compute[71354]:     </disk>
Apr 13 17:46:06 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:06 user nova-compute[71354]:       <mac address="fa:16:3e:17:73:cc"/>
Apr 13 17:46:06 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:06 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:06 user nova-compute[71354]:       <target dev="tap6431e14a-e7"/>
Apr 13 17:46:06 user nova-compute[71354]:     </interface>
Apr 13 17:46:06 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:06 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/console.log" append="off"/>
Apr 13 17:46:06 user nova-compute[71354]:     </serial>
Apr 13 17:46:06 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:06 user nova-compute[71354]:     <video>
Apr 13 17:46:06 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:06 user nova-compute[71354]:     </video>
Apr 13 17:46:06 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:06 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:06 user nova-compute[71354]:     </rng>
Apr 13 17:46:06 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:06 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:06 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:06 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:06 user nova-compute[71354]:   </devices>
Apr 13 17:46:06 user nova-compute[71354]: </domain>
Apr 13 17:46:06 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743764397',display_name='tempest-ServersNegativeTestJSON-server-743764397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743764397',id=2,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-6ywzng84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:45:57Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=bc89ac54-6844-45b9-8dac-c10d893b699b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG os_vif [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6431e14a-e7, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6431e14a-e7, col_values=(('external_ids', {'iface-id': '6431e14a-e7e3-4cb5-9fe6-015c1debef03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:73:cc', 'vm-uuid': 'bc89ac54-6844-45b9-8dac-c10d893b699b'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: INFO os_vif [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7')
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] No VIF found with MAC fa:16:3e:17:73:cc, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Successfully updated port: 067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updated VIF entry in instance network info cache for port 6431e14a-e7e3-4cb5-9fe6-015c1debef03. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fc23813-972b-4b02-9806-8ecd3bc9fa9f req-cb541b70-7635-44b1-8225-77fc750e5122 service nova] Releasing lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-changed-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Refreshing instance network info cache due to event network-changed-067fbe09-ace1-4188-a99f-ee4847a1a311. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance network_info: |[{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.neutron [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Refreshing network info cache for port 067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start _get_guest_xml network_info=[{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:08 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:08 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-1478412498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:08 user nova-compute[71354]:   <uuid>08984ef0-6db9-4a60-b5b9-a6325ec531b1</uuid>
Apr 13 17:46:08 user nova-compute[71354]:   <name>instance-00000003</name>
Apr 13 17:46:08 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:08 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:08 user nova-compute[71354]:   <metadata>
Apr 13 17:46:08 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:08 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-1478412498</nova:name>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:08</nova:creationTime>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:08 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:08 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 17:46:08 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:08 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:08 user nova-compute[71354]:         <nova:port uuid="067fbe09-ace1-4188-a99f-ee4847a1a311">
Apr 13 17:46:08 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:46:08 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:08 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:08 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:08 user nova-compute[71354]:   </metadata>
Apr 13 17:46:08 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:08 user nova-compute[71354]:     <system>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="serial">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="uuid">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:46:08 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:08 user nova-compute[71354]:     </system>
Apr 13 17:46:08 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:08 user nova-compute[71354]:   <os>
Apr 13 17:46:08 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:08 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:08 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:08 user nova-compute[71354]:   </os>
Apr 13 17:46:08 user nova-compute[71354]:   <features>
Apr 13 17:46:08 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:08 user nova-compute[71354]:     <apic/>
Apr 13 17:46:08 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:08 user nova-compute[71354]:   </features>
Apr 13 17:46:08 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:08 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:08 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:08 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:08 user nova-compute[71354]:   </clock>
Apr 13 17:46:08 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:08 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:08 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:08 user nova-compute[71354]:   </cpu>
Apr 13 17:46:08 user nova-compute[71354]:   <devices>
Apr 13 17:46:08 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:08 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:08 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk"/>
Apr 13 17:46:08 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:08 user nova-compute[71354]:     </disk>
Apr 13 17:46:08 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:08 user nova-compute[71354]:       <mac address="fa:16:3e:78:5c:7c"/>
Apr 13 17:46:08 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:08 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:08 user nova-compute[71354]:       <target dev="tap067fbe09-ac"/>
Apr 13 17:46:08 user nova-compute[71354]:     </interface>
Apr 13 17:46:08 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:08 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log" append="off"/>
Apr 13 17:46:08 user nova-compute[71354]:     </serial>
Apr 13 17:46:08 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:08 user nova-compute[71354]:     <video>
Apr 13 17:46:08 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:08 user nova-compute[71354]:     </video>
Apr 13 17:46:08 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:08 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:08 user nova-compute[71354]:     </rng>
Apr 13 17:46:08 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:08 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:08 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:08 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:08 user nova-compute[71354]:   </devices>
Apr 13 17:46:08 user nova-compute[71354]: </domain>
Apr 13 17:46:08 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-1478412498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG os_vif [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067fbe09-ac, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067fbe09-ac, col_values=(('external_ids', {'iface-id': '067fbe09-ace1-4188-a99f-ee4847a1a311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5c:7c', 'vm-uuid': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:08 user nova-compute[71354]: INFO os_vif [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:46:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:78:5c:7c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] No waiting events found dispatching network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:10 user nova-compute[71354]: WARNING nova.compute.manager [req-882b93b7-b9d5-4c4a-b6eb-a0a4900fe9ac req-976e3763-e6e9-47b2-b452-d50531c012ef service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received unexpected event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance with vm_state building and task_state spawning.
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] No waiting events found dispatching network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:10 user nova-compute[71354]: WARNING nova.compute.manager [req-2f48e88a-72fc-46e3-871b-825fcc9dc636 req-9b7c9a1a-f47d-4d85-8169-74865ff4e774 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received unexpected event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance with vm_state building and task_state spawning.
Apr 13 17:46:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.network.neutron [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updated VIF entry in instance network info cache for port 067fbe09-ace1-4188-a99f-ee4847a1a311. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG nova.network.neutron [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ba1ebc98-563c-4537-a55f-41a95cd34bdc req-9229fb5a-8314-42d7-a3c0-8aaff004b655 service nova] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:11 user nova-compute[71354]: WARNING nova.compute.manager [req-eda706e4-49a6-4f09-957a-cb0d69fe2c38 req-7c4fd0b2-3894-41b5-89e0-0ba46b7a3b6a service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state building and task_state spawning.
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Successfully updated port: 9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquired lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407971.616861, bfcf221f-b53a-4e85-9743-ee10ab3c387c => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] VM Resumed (Lifecycle Event)
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Instance spawned successfully.
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407971.6256428, bfcf221f-b53a-4e85-9743-ee10ab3c387c => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] VM Started (Lifecycle Event)
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Took 19.65 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:11 user nova-compute[71354]: INFO nova.compute.manager [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Took 20.48 seconds to build instance.
Apr 13 17:46:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-71480274-f7ee-4aef-b508-1650e9e1b1fd tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.717s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] No waiting events found dispatching network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:12 user nova-compute[71354]: WARNING nova.compute.manager [req-75301478-515f-40d5-94f9-d0ba87b32513 req-1e70a36d-f08e-40d3-b98e-8461ccc77634 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received unexpected event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance with vm_state building and task_state spawning.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407972.5359306, bc89ac54-6844-45b9-8dac-c10d893b699b => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] VM Resumed (Lifecycle Event)
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Instance spawned successfully.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] No waiting events found dispatching network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:12 user nova-compute[71354]: WARNING nova.compute.manager [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received unexpected event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance with vm_state active and task_state None.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-changed-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Refreshing instance network info cache due to event network-changed-9f3a481f-e7ca-439d-a3da-d13613c9bcb6. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Acquiring lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407972.5380373, bc89ac54-6844-45b9-8dac-c10d893b699b => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] VM Started (Lifecycle Event)
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Took 15.23 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:12 user nova-compute[71354]: INFO nova.compute.manager [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Took 15.98 seconds to build instance.
Apr 13 17:46:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a634f73-1681-43e6-a6a0-9ffd016de932 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.132s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:13 user nova-compute[71354]: WARNING nova.compute.manager [req-4aed60a0-93b7-4cca-acda-71e880570587 req-ab90a0c8-ee0f-4754-b416-3cf47fac6be7 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state building and task_state spawning.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407973.3874311, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Resumed (Lifecycle Event)
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance spawned successfully.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Updating instance_info_cache with network_info: [{"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Releasing lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Instance network_info: |[{"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Acquired lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.neutron [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Refreshing network info cache for port 9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Start _get_guest_xml network_info=[{"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407973.396611, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Started (Lifecycle Event)
Apr 13 17:46:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1510345798',display_name='tempest-VolumesActionsTest-instance-1510345798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1510345798',id=4,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a40fa0611d54d5b8a35fcc469fc5361',ramdisk_id='',reservation_id='r-7x0pmhzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1828433590',owner_user_name='tempest-VolumesActionsTest-1828433590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:02Z,user_data=None,user_id='75c1cf6ba73c4adb9124f14d78f4ac16',uuid=fd435a8f-372c-4aab-81b0-a1f76658b5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converting VIF {"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lazy-loading 'pci_devices' on Instance uuid fd435a8f-372c-4aab-81b0-a1f76658b5b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:13 user nova-compute[71354]:   <uuid>fd435a8f-372c-4aab-81b0-a1f76658b5b5</uuid>
Apr 13 17:46:13 user nova-compute[71354]:   <name>instance-00000004</name>
Apr 13 17:46:13 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:13 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:13 user nova-compute[71354]:   <metadata>
Apr 13 17:46:13 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:13 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:name>tempest-VolumesActionsTest-instance-1510345798</nova:name>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:13</nova:creationTime>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:13 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:13 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:user uuid="75c1cf6ba73c4adb9124f14d78f4ac16">tempest-VolumesActionsTest-1828433590-project-member</nova:user>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:project uuid="8a40fa0611d54d5b8a35fcc469fc5361">tempest-VolumesActionsTest-1828433590</nova:project>
Apr 13 17:46:13 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:13 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:13 user nova-compute[71354]:         <nova:port uuid="9f3a481f-e7ca-439d-a3da-d13613c9bcb6">
Apr 13 17:46:13 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:46:13 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:13 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:13 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:13 user nova-compute[71354]:   </metadata>
Apr 13 17:46:13 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:13 user nova-compute[71354]:     <system>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="serial">fd435a8f-372c-4aab-81b0-a1f76658b5b5</entry>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="uuid">fd435a8f-372c-4aab-81b0-a1f76658b5b5</entry>
Apr 13 17:46:13 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:13 user nova-compute[71354]:     </system>
Apr 13 17:46:13 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:13 user nova-compute[71354]:   <os>
Apr 13 17:46:13 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:13 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:13 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:13 user nova-compute[71354]:   </os>
Apr 13 17:46:13 user nova-compute[71354]:   <features>
Apr 13 17:46:13 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:13 user nova-compute[71354]:     <apic/>
Apr 13 17:46:13 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:13 user nova-compute[71354]:   </features>
Apr 13 17:46:13 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:13 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:13 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:13 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:13 user nova-compute[71354]:   </clock>
Apr 13 17:46:13 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:13 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:13 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:13 user nova-compute[71354]:   </cpu>
Apr 13 17:46:13 user nova-compute[71354]:   <devices>
Apr 13 17:46:13 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:13 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:13 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk"/>
Apr 13 17:46:13 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:13 user nova-compute[71354]:     </disk>
Apr 13 17:46:13 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:13 user nova-compute[71354]:       <mac address="fa:16:3e:99:54:15"/>
Apr 13 17:46:13 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:13 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:13 user nova-compute[71354]:       <target dev="tap9f3a481f-e7"/>
Apr 13 17:46:13 user nova-compute[71354]:     </interface>
Apr 13 17:46:13 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:13 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/console.log" append="off"/>
Apr 13 17:46:13 user nova-compute[71354]:     </serial>
Apr 13 17:46:13 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:13 user nova-compute[71354]:     <video>
Apr 13 17:46:13 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:13 user nova-compute[71354]:     </video>
Apr 13 17:46:13 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:13 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:13 user nova-compute[71354]:     </rng>
Apr 13 17:46:13 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:13 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:13 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:13 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:13 user nova-compute[71354]:   </devices>
Apr 13 17:46:13 user nova-compute[71354]: </domain>
Apr 13 17:46:13 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1510345798',display_name='tempest-VolumesActionsTest-instance-1510345798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1510345798',id=4,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a40fa0611d54d5b8a35fcc469fc5361',ramdisk_id='',reservation_id='r-7x0pmhzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1828433590',owner_user_name='tempest-VolumesActionsTest-1828433590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:02Z,user_data=None,user_id='75c1cf6ba73c4adb9124f14d78f4ac16',uuid=fd435a8f-372c-4aab-81b0-a1f76658b5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converting VIF {"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG os_vif [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f3a481f-e7, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f3a481f-e7, col_values=(('external_ids', {'iface-id': '9f3a481f-e7ca-439d-a3da-d13613c9bcb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:54:15', 'vm-uuid': 'fd435a8f-372c-4aab-81b0-a1f76658b5b5'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Took 11.92 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:13 user nova-compute[71354]: INFO os_vif [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7')
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] No VIF found with MAC fa:16:3e:99:54:15, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:13 user nova-compute[71354]: INFO nova.compute.manager [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Took 12.72 seconds to build instance.
Apr 13 17:46:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0100022-d373-470f-b6ee-829ecd1654b3 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.859s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Updated VIF entry in instance network info cache for port 9f3a481f-e7ca-439d-a3da-d13613c9bcb6. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Updating instance_info_cache with network_info: [{"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12836ec4-f7c9-49a9-b828-71aab2a71f1c req-471f12f5-9e62-466b-b24f-8e9f92f9b6fa service nova] Releasing lock "refresh_cache-fd435a8f-372c-4aab-81b0-a1f76658b5b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:16 user nova-compute[71354]: INFO nova.compute.claims [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Claim successful on node user
Apr 13 17:46:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] No waiting events found dispatching network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:16 user nova-compute[71354]: WARNING nova.compute.manager [req-eb23a30d-7700-4266-9bcc-e5f5d8186d06 req-20b12907-f7b5-416e-b24b-c7c059213729 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received unexpected event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance with vm_state building and task_state spawning.
Apr 13 17:46:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.152s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.policy [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbea54954e534fdc933b94936a47a0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984a0fd6f48449a7ba8f9944243580b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Creating image(s)
Apr 13 17:46:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.225s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.200s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk 1073741824" returned: 0 in 0.115s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407978.4577532, fd435a8f-372c-4aab-81b0-a1f76658b5b5 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] VM Resumed (Lifecycle Event)
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Instance spawned successfully.
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] No waiting events found dispatching network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:18 user nova-compute[71354]: WARNING nova.compute.manager [req-0da6711e-d97a-4304-9020-e0da4d9e485e req-6bdb1d71-49f2-41a6-8af1-8080c3c64714 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received unexpected event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance with vm_state building and task_state spawning.
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407978.4616144, fd435a8f-372c-4aab-81b0-a1f76658b5b5 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] VM Started (Lifecycle Event)
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.343s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Took 16.40 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:18 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Cannot resize image /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG nova.objects.instance [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'migration_context' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Ensure instance console log exists: /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:19 user nova-compute[71354]: INFO nova.compute.manager [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Took 17.40 seconds to build instance.
Apr 13 17:46:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-edd9f76a-cb20-4740-8a25-b81434c053ab tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.633s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Successfully created port: 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Successfully updated port: 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing instance network info cache due to event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Instance network_info: |[{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start _get_guest_xml network_info=[{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:23 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:23 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-547648089',display_name='tempest-ServerStableDeviceRescueTest-server-547648089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-547648089',id=5,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+Qp1DpGYd28SffPEL0KXHEyGVeNEzd/4SaNj92SqYaC3oPsix558denqtUGb8CVqhKclqMvdjbWzCvn1ComQgDM/fgeBZ91Z9GAUCB0F7d60nu+OvCRg4Monp5Wob+A==',key_name='tempest-keypair-1772761791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='984a0fd6f48449a7ba8f9944243580b9',ramdisk_id='',reservation_id='r-974o4k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1535501044',owner_user_name='tempest-ServerStableDeviceRescueTest-1535501044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbea54954e534fdc933b94936a47a0b3',uuid=69605608-790d-49be-ab18-277549242bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converting VIF {"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'pci_devices' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:23 user nova-compute[71354]:   <uuid>69605608-790d-49be-ab18-277549242bef</uuid>
Apr 13 17:46:23 user nova-compute[71354]:   <name>instance-00000005</name>
Apr 13 17:46:23 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:23 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:23 user nova-compute[71354]:   <metadata>
Apr 13 17:46:23 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:23 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-547648089</nova:name>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:23</nova:creationTime>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:23 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:23 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:user uuid="cbea54954e534fdc933b94936a47a0b3">tempest-ServerStableDeviceRescueTest-1535501044-project-member</nova:user>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:project uuid="984a0fd6f48449a7ba8f9944243580b9">tempest-ServerStableDeviceRescueTest-1535501044</nova:project>
Apr 13 17:46:23 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:23 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:23 user nova-compute[71354]:         <nova:port uuid="29f94d48-0d45-4fe8-b310-e02fb491f42f">
Apr 13 17:46:23 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:46:23 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:23 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:23 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:23 user nova-compute[71354]:   </metadata>
Apr 13 17:46:23 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:23 user nova-compute[71354]:     <system>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="serial">69605608-790d-49be-ab18-277549242bef</entry>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="uuid">69605608-790d-49be-ab18-277549242bef</entry>
Apr 13 17:46:23 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:23 user nova-compute[71354]:     </system>
Apr 13 17:46:23 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:23 user nova-compute[71354]:   <os>
Apr 13 17:46:23 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:23 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:23 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:23 user nova-compute[71354]:   </os>
Apr 13 17:46:23 user nova-compute[71354]:   <features>
Apr 13 17:46:23 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:23 user nova-compute[71354]:     <apic/>
Apr 13 17:46:23 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:23 user nova-compute[71354]:   </features>
Apr 13 17:46:23 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:23 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:23 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:23 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:23 user nova-compute[71354]:   </clock>
Apr 13 17:46:23 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:23 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:23 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:23 user nova-compute[71354]:   </cpu>
Apr 13 17:46:23 user nova-compute[71354]:   <devices>
Apr 13 17:46:23 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:23 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:23 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk"/>
Apr 13 17:46:23 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:23 user nova-compute[71354]:     </disk>
Apr 13 17:46:23 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:23 user nova-compute[71354]:       <mac address="fa:16:3e:ae:a9:e8"/>
Apr 13 17:46:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:23 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:23 user nova-compute[71354]:       <target dev="tap29f94d48-0d"/>
Apr 13 17:46:23 user nova-compute[71354]:     </interface>
Apr 13 17:46:23 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:23 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/console.log" append="off"/>
Apr 13 17:46:23 user nova-compute[71354]:     </serial>
Apr 13 17:46:23 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:23 user nova-compute[71354]:     <video>
Apr 13 17:46:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:23 user nova-compute[71354]:     </video>
Apr 13 17:46:23 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:23 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:23 user nova-compute[71354]:     </rng>
Apr 13 17:46:23 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:23 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:23 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:23 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:23 user nova-compute[71354]:   </devices>
Apr 13 17:46:23 user nova-compute[71354]: </domain>
Apr 13 17:46:23 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-547648089',display_name='tempest-ServerStableDeviceRescueTest-server-547648089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-547648089',id=5,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+Qp1DpGYd28SffPEL0KXHEyGVeNEzd/4SaNj92SqYaC3oPsix558denqtUGb8CVqhKclqMvdjbWzCvn1ComQgDM/fgeBZ91Z9GAUCB0F7d60nu+OvCRg4Monp5Wob+A==',key_name='tempest-keypair-1772761791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='984a0fd6f48449a7ba8f9944243580b9',ramdisk_id='',reservation_id='r-974o4k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1535501044',owner_user_name='tempest-ServerStableDeviceRescueTest-1535501044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbea54954e534fdc933b94936a47a0b3',uuid=69605608-790d-49be-ab18-277549242bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converting VIF {"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG os_vif [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29f94d48-0d, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29f94d48-0d, col_values=(('external_ids', {'iface-id': '29f94d48-0d45-4fe8-b310-e02fb491f42f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:a9:e8', 'vm-uuid': '69605608-790d-49be-ab18-277549242bef'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:23 user nova-compute[71354]: INFO os_vif [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d')
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No VIF found with MAC fa:16:3e:ae:a9:e8, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:23 user nova-compute[71354]: INFO nova.compute.claims [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Claim successful on node user
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.804s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:24 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updated VIF entry in instance network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-685faf23-1f0f-4f0b-9ed1-4a77d773a036 req-1d5056d1-8736-44e3-b7fa-aa005ad3f921 service nova] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:24 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Creating image(s)
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "/opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "/opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "/opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.066s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.policy [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.171s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.271s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:25 user nova-compute[71354]: WARNING nova.compute.manager [req-1a0627a7-5fd1-4dcc-bd54-c4dd717482c5 req-281fa638-bfd0-41ef-af69-e71250fdf9ae service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state building and task_state spawning.
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk 1073741824" returned: 0 in 0.118s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Cannot resize image /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'migration_context' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Ensure instance console log exists: /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:26 user nova-compute[71354]: INFO nova.compute.claims [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Claim successful on node user
Apr 13 17:46:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Successfully created port: 965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.policy [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f5fc6a5e3a54d619d57cb94bdb304c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900c1c4928514f198a3b630de0216b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:26 user nova-compute[71354]: INFO nova.compute.claims [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Claim successful on node user
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Creating image(s)
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.part --force-share --output=json" returned: 0 in 0.162s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.virt.images [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 5f64c281-530b-48dc-b419-d28e323bbf14 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.part /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:27 user nova-compute[71354]: WARNING nova.compute.manager [req-5637d6c9-9b6d-4765-9639-0939428e5291 req-b5ae6cd6-164c-4e32-8cc2-d2e02601abed service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state building and task_state spawning.
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Successfully updated port: 965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-changed-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Refreshing instance network info cache due to event network-changed-965ec80e-f2ad-4833-b6e7-bd8c13e3973c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Acquiring lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Acquired lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Refreshing network info cache for port 965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:27 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.171s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.part /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.converted" returned: 0 in 0.526s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Successfully created port: d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.434s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407988.4367328, 69605608-790d-49be-ab18-277549242bef => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Resumed (Lifecycle Event)
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 69605608-790d-49be-ab18-277549242bef] Instance spawned successfully.
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.policy [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3023cacc072d43119d59765f0e0c5da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2125d26c69b434380ee15d03c9a196b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Creating image(s)
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "/opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "/opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407988.4378812, 69605608-790d-49be-ab18-277549242bef => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Started (Lifecycle Event)
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f78c52df-a622-4f97-9281-83187605d206 req-39deef6e-4f3c-44b2-9636-6064fc1c4c61 service nova] Releasing lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquired lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:28 user nova-compute[71354]: INFO nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Took 10.95 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json" returned: 0 in 0.360s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.220s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json" returned: 0 in 0.189s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd,backing_fmt=raw /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd,backing_fmt=raw /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk 1073741824" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.257s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "7072e7ac849018b6c2092f5ad283dabcb62397bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: INFO nova.compute.manager [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Took 13.17 seconds to build instance.
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk 1073741824" returned: 0 in 0.107s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.450s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Successfully updated port: d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-32dcd6a1-9444-4a76-96b8-93d8a61e9b19 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd --force-share --output=json" returned: 0 in 0.265s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquired lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.247s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Cannot resize image /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.objects.instance [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'migration_context' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Ensure instance console log exists: /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-changed-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Refreshing instance network info cache due to event network-changed-d6142a48-379f-470e-aaf0-a2dd0e626d72. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Acquiring lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [{"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Releasing lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance network_info: |[{"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Start _get_guest_xml network_info=[{"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Cannot resize image /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'migration_context' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Ensure instance console log exists: /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:29 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:29 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-394613299',display_name='tempest-VolumesAdminNegativeTest-server-394613299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-394613299',id=6,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNL/l3knLiGldwyflv/CZJe/UzD7tOPLEZPBkP18IAdcrOMkyDnl46cyo3jZSIFKOsS8+fVwmaiY3fk0liB5b07xzaHFCyr8+LNzfg1+EXTpq2CFfBk1qtKS/qY8fmuYw==',key_name='tempest-keypair-1911294089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-jc6lvtt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=85f8857e-9e9b-4a5a-912a-4d79014417d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.objects.instance [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'pci_devices' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:29 user nova-compute[71354]:   <uuid>85f8857e-9e9b-4a5a-912a-4d79014417d0</uuid>
Apr 13 17:46:29 user nova-compute[71354]:   <name>instance-00000006</name>
Apr 13 17:46:29 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:29 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:29 user nova-compute[71354]:   <metadata>
Apr 13 17:46:29 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:29 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:name>tempest-VolumesAdminNegativeTest-server-394613299</nova:name>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:29</nova:creationTime>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:29 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:29 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:user uuid="5d77fa5340ce44099224f2f161af5ecc">tempest-VolumesAdminNegativeTest-1540143869-project-member</nova:user>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:project uuid="2d6ea575d2574fcc99712adece6db415">tempest-VolumesAdminNegativeTest-1540143869</nova:project>
Apr 13 17:46:29 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:29 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:29 user nova-compute[71354]:         <nova:port uuid="965ec80e-f2ad-4833-b6e7-bd8c13e3973c">
Apr 13 17:46:29 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:46:29 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:29 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:29 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:29 user nova-compute[71354]:   </metadata>
Apr 13 17:46:29 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:29 user nova-compute[71354]:     <system>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="serial">85f8857e-9e9b-4a5a-912a-4d79014417d0</entry>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="uuid">85f8857e-9e9b-4a5a-912a-4d79014417d0</entry>
Apr 13 17:46:29 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:29 user nova-compute[71354]:     </system>
Apr 13 17:46:29 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:29 user nova-compute[71354]:   <os>
Apr 13 17:46:29 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:29 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:29 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:29 user nova-compute[71354]:   </os>
Apr 13 17:46:29 user nova-compute[71354]:   <features>
Apr 13 17:46:29 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:29 user nova-compute[71354]:     <apic/>
Apr 13 17:46:29 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:29 user nova-compute[71354]:   </features>
Apr 13 17:46:29 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:29 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:29 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:29 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:29 user nova-compute[71354]:   </clock>
Apr 13 17:46:29 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:29 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:29 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:29 user nova-compute[71354]:   </cpu>
Apr 13 17:46:29 user nova-compute[71354]:   <devices>
Apr 13 17:46:29 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:29 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:29 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk"/>
Apr 13 17:46:29 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:29 user nova-compute[71354]:     </disk>
Apr 13 17:46:29 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:29 user nova-compute[71354]:       <mac address="fa:16:3e:d2:a0:af"/>
Apr 13 17:46:29 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:29 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:29 user nova-compute[71354]:       <target dev="tap965ec80e-f2"/>
Apr 13 17:46:29 user nova-compute[71354]:     </interface>
Apr 13 17:46:29 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:29 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/console.log" append="off"/>
Apr 13 17:46:29 user nova-compute[71354]:     </serial>
Apr 13 17:46:29 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:29 user nova-compute[71354]:     <video>
Apr 13 17:46:29 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:29 user nova-compute[71354]:     </video>
Apr 13 17:46:29 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:29 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:29 user nova-compute[71354]:     </rng>
Apr 13 17:46:29 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:29 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:29 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:29 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:29 user nova-compute[71354]:   </devices>
Apr 13 17:46:29 user nova-compute[71354]: </domain>
Apr 13 17:46:29 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-394613299',display_name='tempest-VolumesAdminNegativeTest-server-394613299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-394613299',id=6,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNL/l3knLiGldwyflv/CZJe/UzD7tOPLEZPBkP18IAdcrOMkyDnl46cyo3jZSIFKOsS8+fVwmaiY3fk0liB5b07xzaHFCyr8+LNzfg1+EXTpq2CFfBk1qtKS/qY8fmuYw==',key_name='tempest-keypair-1911294089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-jc6lvtt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=85f8857e-9e9b-4a5a-912a-4d79014417d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG os_vif [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap965ec80e-f2, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap965ec80e-f2, col_values=(('external_ids', {'iface-id': '965ec80e-f2ad-4833-b6e7-bd8c13e3973c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:a0:af', 'vm-uuid': '85f8857e-9e9b-4a5a-912a-4d79014417d0'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:29 user nova-compute[71354]: INFO os_vif [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2')
Apr 13 17:46:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Successfully created port: 0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No VIF found with MAC fa:16:3e:d2:a0:af, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updating instance_info_cache with network_info: [{"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Releasing lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Instance network_info: |[{"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Acquired lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.neutron [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Refreshing network info cache for port d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Start _get_guest_xml network_info=[{"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:46:15Z,direct_url=<?>,disk_format='qcow2',id=5f64c281-530b-48dc-b419-d28e323bbf14,min_disk=0,min_ram=0,name='',owner='f4737e4b05084e9ba8293ac4cfe041bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:46:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'size': 0, 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': '5f64c281-530b-48dc-b419-d28e323bbf14'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:30 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:30 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:46:15Z,direct_url=<?>,disk_format='qcow2',id=5f64c281-530b-48dc-b419-d28e323bbf14,min_disk=0,min_ram=0,name='',owner='f4737e4b05084e9ba8293ac4cfe041bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:46:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2041945976',display_name='tempest-AttachSCSIVolumeTestJSON-server-2041945976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2041945976',id=7,image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU+SDMniOXw84ibDM7Gr2Fasc8Cy3YObgo+qLbZd0zzuH5EuEl03YcmcoTwxkNgNPk/4Qn+WhACjat3sYKtHXLyw6ONjwOG/Fi6pR193B3tO1ZEkqk3Wu2MsP2bSP51Bg==',key_name='tempest-keypair-1143642649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='900c1c4928514f198a3b630de0216b60',ramdisk_id='',reservation_id='r-i52k27dv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-957875763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-957875763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f5fc6a5e3a54d619d57cb94bdb304c5',uuid=1a1b241a-4461-41d9-8890-012ddbda76df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converting VIF {"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:30 user nova-compute[71354]:   <uuid>1a1b241a-4461-41d9-8890-012ddbda76df</uuid>
Apr 13 17:46:30 user nova-compute[71354]:   <name>instance-00000007</name>
Apr 13 17:46:30 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:30 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:30 user nova-compute[71354]:   <metadata>
Apr 13 17:46:30 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:30 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2041945976</nova:name>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:30</nova:creationTime>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:30 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:30 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:user uuid="8f5fc6a5e3a54d619d57cb94bdb304c5">tempest-AttachSCSIVolumeTestJSON-957875763-project-member</nova:user>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:project uuid="900c1c4928514f198a3b630de0216b60">tempest-AttachSCSIVolumeTestJSON-957875763</nova:project>
Apr 13 17:46:30 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:root type="image" uuid="5f64c281-530b-48dc-b419-d28e323bbf14"/>
Apr 13 17:46:30 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:30 user nova-compute[71354]:         <nova:port uuid="d6142a48-379f-470e-aaf0-a2dd0e626d72">
Apr 13 17:46:30 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:46:30 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:30 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:30 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:30 user nova-compute[71354]:   </metadata>
Apr 13 17:46:30 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:30 user nova-compute[71354]:     <system>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="serial">1a1b241a-4461-41d9-8890-012ddbda76df</entry>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="uuid">1a1b241a-4461-41d9-8890-012ddbda76df</entry>
Apr 13 17:46:30 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:30 user nova-compute[71354]:     </system>
Apr 13 17:46:30 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:30 user nova-compute[71354]:   <os>
Apr 13 17:46:30 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:30 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:30 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:30 user nova-compute[71354]:   </os>
Apr 13 17:46:30 user nova-compute[71354]:   <features>
Apr 13 17:46:30 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:30 user nova-compute[71354]:     <apic/>
Apr 13 17:46:30 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:30 user nova-compute[71354]:   </features>
Apr 13 17:46:30 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:30 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:30 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:30 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:30 user nova-compute[71354]:   </clock>
Apr 13 17:46:30 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:30 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:30 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:30 user nova-compute[71354]:   </cpu>
Apr 13 17:46:30 user nova-compute[71354]:   <devices>
Apr 13 17:46:30 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:30 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:30 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk"/>
Apr 13 17:46:30 user nova-compute[71354]:       <target dev="sda" bus="scsi"/>
Apr 13 17:46:30 user nova-compute[71354]:       <address type="drive" controller="0" unit="0"/>
Apr 13 17:46:30 user nova-compute[71354]:     </disk>
Apr 13 17:46:30 user nova-compute[71354]:     <disk type="file" device="cdrom">
Apr 13 17:46:30 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 17:46:30 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.config"/>
Apr 13 17:46:30 user nova-compute[71354]:       <target dev="sdb" bus="scsi"/>
Apr 13 17:46:30 user nova-compute[71354]:       <address type="drive" controller="0" unit="1"/>
Apr 13 17:46:30 user nova-compute[71354]:     </disk>
Apr 13 17:46:30 user nova-compute[71354]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 17:46:30 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:30 user nova-compute[71354]:       <mac address="fa:16:3e:99:fa:bd"/>
Apr 13 17:46:30 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:30 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:30 user nova-compute[71354]:       <target dev="tapd6142a48-37"/>
Apr 13 17:46:30 user nova-compute[71354]:     </interface>
Apr 13 17:46:30 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:30 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/console.log" append="off"/>
Apr 13 17:46:30 user nova-compute[71354]:     </serial>
Apr 13 17:46:30 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:30 user nova-compute[71354]:     <video>
Apr 13 17:46:30 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:30 user nova-compute[71354]:     </video>
Apr 13 17:46:30 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:30 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:30 user nova-compute[71354]:     </rng>
Apr 13 17:46:30 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:30 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:30 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:30 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:30 user nova-compute[71354]:   </devices>
Apr 13 17:46:30 user nova-compute[71354]: </domain>
Apr 13 17:46:30 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2041945976',display_name='tempest-AttachSCSIVolumeTestJSON-server-2041945976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2041945976',id=7,image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU+SDMniOXw84ibDM7Gr2Fasc8Cy3YObgo+qLbZd0zzuH5EuEl03YcmcoTwxkNgNPk/4Qn+WhACjat3sYKtHXLyw6ONjwOG/Fi6pR193B3tO1ZEkqk3Wu2MsP2bSP51Bg==',key_name='tempest-keypair-1143642649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='900c1c4928514f198a3b630de0216b60',ramdisk_id='',reservation_id='r-i52k27dv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-957875763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-957875763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f5fc6a5e3a54d619d57cb94bdb304c5',uuid=1a1b241a-4461-41d9-8890-012ddbda76df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converting VIF {"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG os_vif [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6142a48-37, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6142a48-37, col_values=(('external_ids', {'iface-id': 'd6142a48-379f-470e-aaf0-a2dd0e626d72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:fa:bd', 'vm-uuid': '1a1b241a-4461-41d9-8890-012ddbda76df'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:30 user nova-compute[71354]: INFO os_vif [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37')
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No BDM found with device name sda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No VIF found with MAC fa:16:3e:99:fa:bd, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Using config drive
Apr 13 17:46:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Creating config drive at /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.config
Apr 13 17:46:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfi9w83er {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfi9w83er" returned: 0 in 0.064s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Successfully updated port: 0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquired lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-changed-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Refreshing instance network info cache due to event network-changed-0111f3ea-a151-4ee0-8497-c181f4c2d9dd. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Acquiring lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updated VIF entry in instance network info cache for port d6142a48-379f-470e-aaf0-a2dd0e626d72. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updating instance_info_cache with network_info: [{"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e84f6942-88d3-44f3-8562-53c78afb7614 req-34eca9a6-cf8c-4546-b2f7-d64396f7e5af service nova] Releasing lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating instance_info_cache with network_info: [{"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Releasing lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Instance network_info: |[{"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:46:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Acquired lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Refreshing network info cache for port 0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Start _get_guest_xml network_info=[{"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:46:32 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:32 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1753786794',display_name='tempest-TestVolumeSwap-server-1753786794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1753786794',id=8,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHliqmBvXni1z1lSQ9+BPDZpXY+5Ahm8yw2vvM1dM/dD3VVaH+n290mcGYbV0smQzfAewnTjJfL5irp7biydbsFyUv3y2r7mdKjKMJg2VeEnlJlYqpcHulTXS5EGf6D/w==',key_name='tempest-keypair-573436766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2125d26c69b434380ee15d03c9a196b',ramdisk_id='',reservation_id='r-hrbj5saj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-197886889',owner_user_name='tempest-TestVolumeSwap-197886889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3023cacc072d43119d59765f0e0c5da7',uuid=fd2c1fea-4a6b-4ccb-956a-d67282ecbb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converting VIF {"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'pci_devices' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:46:32 user nova-compute[71354]:   <uuid>fd2c1fea-4a6b-4ccb-956a-d67282ecbb11</uuid>
Apr 13 17:46:32 user nova-compute[71354]:   <name>instance-00000008</name>
Apr 13 17:46:32 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:46:32 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:46:32 user nova-compute[71354]:   <metadata>
Apr 13 17:46:32 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:46:32 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:name>tempest-TestVolumeSwap-server-1753786794</nova:name>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:46:32</nova:creationTime>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:46:32 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:46:32 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:owner>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:user uuid="3023cacc072d43119d59765f0e0c5da7">tempest-TestVolumeSwap-197886889-project-member</nova:user>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:project uuid="c2125d26c69b434380ee15d03c9a196b">tempest-TestVolumeSwap-197886889</nova:project>
Apr 13 17:46:32 user nova-compute[71354]:       </nova:owner>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:46:32 user nova-compute[71354]:       <nova:ports>
Apr 13 17:46:32 user nova-compute[71354]:         <nova:port uuid="0111f3ea-a151-4ee0-8497-c181f4c2d9dd">
Apr 13 17:46:32 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:46:32 user nova-compute[71354]:         </nova:port>
Apr 13 17:46:32 user nova-compute[71354]:       </nova:ports>
Apr 13 17:46:32 user nova-compute[71354]:     </nova:instance>
Apr 13 17:46:32 user nova-compute[71354]:   </metadata>
Apr 13 17:46:32 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:46:32 user nova-compute[71354]:     <system>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="serial">fd2c1fea-4a6b-4ccb-956a-d67282ecbb11</entry>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="uuid">fd2c1fea-4a6b-4ccb-956a-d67282ecbb11</entry>
Apr 13 17:46:32 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:46:32 user nova-compute[71354]:     </system>
Apr 13 17:46:32 user nova-compute[71354]:   </sysinfo>
Apr 13 17:46:32 user nova-compute[71354]:   <os>
Apr 13 17:46:32 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:46:32 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:46:32 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:46:32 user nova-compute[71354]:   </os>
Apr 13 17:46:32 user nova-compute[71354]:   <features>
Apr 13 17:46:32 user nova-compute[71354]:     <acpi/>
Apr 13 17:46:32 user nova-compute[71354]:     <apic/>
Apr 13 17:46:32 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:46:32 user nova-compute[71354]:   </features>
Apr 13 17:46:32 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:46:32 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:46:32 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:46:32 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:46:32 user nova-compute[71354]:   </clock>
Apr 13 17:46:32 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:46:32 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:46:32 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:46:32 user nova-compute[71354]:   </cpu>
Apr 13 17:46:32 user nova-compute[71354]:   <devices>
Apr 13 17:46:32 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:46:32 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:46:32 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk"/>
Apr 13 17:46:32 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:46:32 user nova-compute[71354]:     </disk>
Apr 13 17:46:32 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:46:32 user nova-compute[71354]:       <mac address="fa:16:3e:5c:b5:5e"/>
Apr 13 17:46:32 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:32 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:46:32 user nova-compute[71354]:       <target dev="tap0111f3ea-a1"/>
Apr 13 17:46:32 user nova-compute[71354]:     </interface>
Apr 13 17:46:32 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:46:32 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/console.log" append="off"/>
Apr 13 17:46:32 user nova-compute[71354]:     </serial>
Apr 13 17:46:32 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:46:32 user nova-compute[71354]:     <video>
Apr 13 17:46:32 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:46:32 user nova-compute[71354]:     </video>
Apr 13 17:46:32 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:46:32 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:46:32 user nova-compute[71354]:     </rng>
Apr 13 17:46:32 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:46:32 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:46:32 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:46:32 user nova-compute[71354]:     </memballoon>
Apr 13 17:46:32 user nova-compute[71354]:   </devices>
Apr 13 17:46:32 user nova-compute[71354]: </domain>
Apr 13 17:46:32 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1753786794',display_name='tempest-TestVolumeSwap-server-1753786794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1753786794',id=8,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHliqmBvXni1z1lSQ9+BPDZpXY+5Ahm8yw2vvM1dM/dD3VVaH+n290mcGYbV0smQzfAewnTjJfL5irp7biydbsFyUv3y2r7mdKjKMJg2VeEnlJlYqpcHulTXS5EGf6D/w==',key_name='tempest-keypair-573436766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2125d26c69b434380ee15d03c9a196b',ramdisk_id='',reservation_id='r-hrbj5saj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-197886889',owner_user_name='tempest-TestVolumeSwap-197886889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3023cacc072d43119d59765f0e0c5da7',uuid=fd2c1fea-4a6b-4ccb-956a-d67282ecbb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converting VIF {"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG os_vif [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0111f3ea-a1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0111f3ea-a1, col_values=(('external_ids', {'iface-id': '0111f3ea-a151-4ee0-8497-c181f4c2d9dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:b5:5e', 'vm-uuid': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:32 user nova-compute[71354]: INFO os_vif [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1')
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] No VIF found with MAC fa:16:3e:5c:b5:5e, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updated VIF entry in instance network info cache for port 0111f3ea-a151-4ee0-8497-c181f4c2d9dd. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating instance_info_cache with network_info: [{"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2ec3c468-206a-43b6-a958-b9bf6c2ad15e req-60fb65f9-474b-4e11-b44a-197dcaa91b67 service nova] Releasing lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] No waiting events found dispatching network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:33 user nova-compute[71354]: WARNING nova.compute.manager [req-490cf286-ce80-4925-82f8-f2f9239c7b38 req-70dadeb4-d929-473e-8040-4bab61eb5a2e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received unexpected event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance with vm_state building and task_state spawning.
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] No waiting events found dispatching network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:35 user nova-compute[71354]: WARNING nova.compute.manager [req-ed89b7c3-1631-4823-a92d-0c8f4428efe5 req-34254cf8-6b18-43ee-938a-44ca6cf812d0 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received unexpected event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance with vm_state building and task_state spawning.
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] No waiting events found dispatching network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:35 user nova-compute[71354]: WARNING nova.compute.manager [req-7d2b70ea-b211-45b2-b89d-deb798492a5b req-75fe5f40-9732-4718-86f9-1f670b68a55b service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received unexpected event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance with vm_state building and task_state spawning.
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] No waiting events found dispatching network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:35 user nova-compute[71354]: WARNING nova.compute.manager [req-06ecb07b-bd60-48ff-9892-de43ba1aa446 req-312b861c-da5d-4625-ad69-9da1f5a2d8aa service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received unexpected event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance with vm_state building and task_state spawning.
Apr 13 17:46:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] No waiting events found dispatching network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:37 user nova-compute[71354]: WARNING nova.compute.manager [req-9b9c9bf6-6de0-4b92-abb1-9b7fc8206ad2 req-15edd55d-3f1d-41b0-aafe-0c97a90cb339 service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received unexpected event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance with vm_state building and task_state spawning.
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] No waiting events found dispatching network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:46:37 user nova-compute[71354]: WARNING nova.compute.manager [req-e2da0eeb-fbda-4f3f-a500-c40933b8a11c req-c9132ee1-bc3d-4781-af02-f32f3a0152f8 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received unexpected event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance with vm_state building and task_state spawning.
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407997.9117467, 1a1b241a-4461-41d9-8890-012ddbda76df => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] VM Resumed (Lifecycle Event)
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Instance spawned successfully.
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Instance spawned successfully.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407997.9234478, 1a1b241a-4461-41d9-8890-012ddbda76df => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] VM Started (Lifecycle Event)
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Took 11.13 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407997.9608955, fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] VM Resumed (Lifecycle Event)
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance spawned successfully.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407997.9670167, fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] VM Started (Lifecycle Event)
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Took 12.24 seconds to build instance.
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Took 9.67 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Took 13.42 seconds to spawn the instance on the hypervisor.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407998.1303952, 85f8857e-9e9b-4a5a-912a-4d79014417d0 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] VM Resumed (Lifecycle Event)
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-83b3a6ea-689b-458d-8784-089b5bea67ec tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.445s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681407998.1314857, 85f8857e-9e9b-4a5a-912a-4d79014417d0 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] VM Started (Lifecycle Event)
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Took 11.50 seconds to build instance.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab1b25f4-70eb-4877-a63f-6c007ae16910 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.613s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:38 user nova-compute[71354]: INFO nova.compute.manager [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Took 14.76 seconds to build instance.
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-484f9446-335c-4e5a-9e66-d9a2bc64fb1c tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.877s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:46:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:46:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating instance_info_cache with network_info: [{"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-bfcf221f-b53a-4e85-9743-ee10ab3c387c" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:46 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:46 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=26.661392211914062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1a1b241a-4461-41d9-8890-012ddbda76df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:46:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:46:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:54 user nova-compute[71354]: INFO nova.compute.claims [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Claim successful on node user
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:54 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:55 user nova-compute[71354]: INFO nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Booting with volume 267ae4b0-e7ad-4ed8-abec-00760971ce21 at /dev/vda
Apr 13 17:46:55 user nova-compute[71354]: DEBUG nova.policy [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b46c336863a41f8a8429fdad30297a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b192b3270576450b8c39368f07d1fae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:46:55 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5xnl1gvu/privsep.sock']
Apr 13 17:46:55 user sudo[81465]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5xnl1gvu/privsep.sock
Apr 13 17:46:55 user sudo[81465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 17:46:55 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully created port: 054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully created port: 2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:56 user sudo[81465]: pam_unix(sudo:session): session closed for user root
Apr 13 17:46:56 user nova-compute[71354]: INFO oslo.privsep.daemon [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Spawned new privsep daemon via rootwrap
Apr 13 17:46:56 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 17:46:56 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 17:46:56 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 17:46:56 user nova-compute[71354]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81468
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[09527361-9014-47ea-9818-2417148d0acc]: (2,) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b8654-cd4c-4a96-9bb8-0c411fd5666c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: WARNING os_brick.initiator.connectors.nvmeof [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57d5a0-36a9-4f61-90d5-f2dd7b472d59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8408aa8-9628-424d-8ba5-5f208287939a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cf1750-2895-493d-b3f8-820bf5f3e386]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:46:57 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[806c8c26-9729-4440-b660-04a10c8b4573]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== get_connector_properties: return (2132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating existing volume attachment record: a10acc04-0f75-4fa4-ab31-27d70d34506f {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:46:57 user nova-compute[71354]: INFO nova.compute.claims [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Claim successful on node user
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully created port: 90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:46:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:46:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:46:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:46:58 user nova-compute[71354]: INFO nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Booting with volume 193d8f02-ca54-46d6-896c-694afc0eef51 at /dev/vda
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG nova.policy [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c62d905cbf3043c28a2a0ad2cab40197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff9543b4dea4fe094f886408bfa5865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9f3bb-a863-4a66-b000-139a0e941eb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf1664-14d0-42c8-ae36-e09d6b75f2c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f4b310-0e2f-489a-8e4e-699fe3b1ef67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[107204bb-c4d7-4799-91e2-898e498e0fab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:46:58 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:46:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3944268-c105-4876-be66-b7e0957dc541]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating existing volume attachment record: 38b88ed2-99d2-45a5-a55f-b9c88f7a2cbe {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:46:58 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully created port: 7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:59 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully created port: 07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:59 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully created port: 365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:46:59 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully created port: c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully created port: fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-054f8815-c1d1-4b57-9018-a34c8e785b80. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.network.neutron [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.network.neutron [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG nova.network.neutron [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bb25a3-9d89-434d-a461-8504de825c84 req-12f8d066-e354-44f8-9917-39a6f38da335 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully created port: 09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully created port: 4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-9dd21baf-0c87-4035-817b-3ecf6dad3ec1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: 07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-07509622-d164-4038-ba75-5bf6cd52d615. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-f454a828-50c6-43ba-ae8b-f2b86adbde6d. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-18475f50-7768-42d6-aaa6-c538f67cd874 req-6a1b5941-e0c0-4df1-b730-f01938566309 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:03 user nova-compute[71354]: INFO nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Booting with volume d8bbde54-82c8-4365-80db-fc400c9cf78e at /dev/vdb
Apr 13 17:47:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:03 user nova-compute[71354]: INFO nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Booting with volume 76bf1eb0-235d-4aec-8895-594830d9b8ce at /dev/vdb
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-696b53f0-6268-46da-a166-4021a305a998 req-519c9fb4-1ac3-44a3-a9b1-2ad9034b0a96 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7231b3-0500-450c-8069-68475b8524f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a605396e-257e-485b-a739-47ff9df7f13a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4212fd-640e-4b24-9a73-409d4434b0ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab5da80-b2ab-41fd-9881-f916b5c8cbe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: 7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0bf118-4945-417b-b65b-29fa1dbb1df0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:03 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ddf6d0-f508-40e4-a7c9-3378dccb7c51]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating existing volume attachment record: 5f705b6c-6b88-479b-9fd4-7c6a5fa50f5e {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c357aed1-8b66-462a-a046-7934890ce284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[832032a1-e441-4aed-891c-ae82a40f476f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72630ced-9e6c-4029-a81d-130d6989ba05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:03 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:47:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a647e-3828-4b25-9e7a-4e4cc64bd289]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating existing volume attachment record: f1871334-6cb8-42ad-9a26-303015f106da {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:47:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: 8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-2968f077-89fd-47b8-b2d8-2be699130a08. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-8a952bca-a9c0-4f7b-a8d5-8639983809cf. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-90e3c9b9-b913-43e7-b7af-72f5ab808b6e. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7a39bd4f-a7eb-4068-afed-9829bec68731 req-f54863c0-5ba8-49a2-b91a-56fe74bea536 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0790f2d1-1bfc-4d2c-a7df-7cf71f092544 req-c502c8ed-75cd-462b-be2b-3c79553a789b service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Successfully updated port: 365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: 09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-7794066e-1eb8-4f57-b683-af981db15421. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-c69b7013-5290-4bec-91d4-d1c86c94e982. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-fc44eb24-78a4-4ead-a4fc-c35b8c943f63. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Successfully updated port: 4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-09e76676-6015-4205-bd23-b86f896fb6d1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e40df1-e2c9-4acf-b6ab-b0f645ba6a30 req-4202190a-4b0d-4059-ba50-18f3f8461ab0 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:47:08 user nova-compute[71354]: INFO nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Booting with volume 13ffd808-19cd-4644-b2e5-3a85520a4d43 at /dev/vdc
Apr 13 17:47:08 user nova-compute[71354]: INFO nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Booting with volume eb71648a-a496-4b94-a14e-061f9eb3b3db at /dev/vdc
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0cd37-a891-411a-9c94-8601a741d3a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8a3176-38a0-42a3-9dd8-341591683959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fe482-1715-40a3-ae9b-87f2f6a22cf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a415ab6-4fb2-4ed0-af7a-22632a1da54d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16d0c50-17b0-43e1-a819-30dbadbbd320]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:08 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6032be-249e-4b54-b217-f8123ec536b3]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.utils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating existing volume attachment record: ffe2289f-4039-44ce-93b7-77c8757f50f9 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9480fd-e203-4f44-8a3a-fb624f914ab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b09a9d3-45c1-4f23-bbfb-c0eb67a77d25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfbd214-4e57-4656-a5da-d0b412ae2070]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:08 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607f770-ac7d-499a-973c-e643f6b88cc0]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG os_brick.utils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating existing volume attachment record: 4217dc9a-0cc2-43a5-b841-a89752c54216 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-4f9e9206-943a-43f9-a511-18ed9e8b8c40. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance network_info: |[{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:47:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:09 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updated VIF entry in instance network info cache for port 7794066e-1eb8-4f57-b683-af981db15421. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-365ecb91-8df1-419a-b559-ab5f41e6e38f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updated VIF entry in instance network info cache for port 365ecb91-8df1-419a-b559-ab5f41e6e38f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c29d703f-ecfa-4775-b45e-a0371adc6fbf req-2d890456-bc7e-41b7-8dff-f65585e844c6 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance network_info: |[{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updated VIF entry in instance network info cache for port 4f9e9206-943a-43f9-a511-18ed9e8b8c40. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-de6bf116-3197-4b31-b775-03705b54246f req-f8eeb93b-983c-460d-969f-0bbbeb688872 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:47:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Creating image(s)
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Ensure instance console log exists: /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Start _get_guest_xml network_info=[{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '38b88ed2-99d2-45a5-a55f-b9c88f7a2cbe', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNqACzdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f', 'attached_at': '', 'detached_at': '', 'volume_id': '193d8f02-ca54-46d6-896c-694afc0eef51', 'serial': '193d8f02-ca54-46d6-896c-694afc0eef51'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': '5f705b6c-6b88-479b-9fd4-7c6a5fa50f5e', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBbqQyRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8bbde54-82c8-4365-80db-fc400c9cf78e', 'serial': 'd8bbde54-82c8-4365-80db-fc400c9cf78e'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': 'ffe2289f-4039-44ce-93b7-77c8757f50f9', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwlsntAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f', 'attached_at': '', 'detached_at': '', 'volume_id': '13ffd808-19cd-4644-b2e5-3a85520a4d43', 'serial': '13ffd808-19cd-4644-b2e5-3a85520a4d43'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:47:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.004s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connector [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Factory for ISCSI on None {{(pid=71354) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.016s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNqACzdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:13 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02875e31-b751-4707-98ce-35d350e02398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:13 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a87a2-4dba-40ed-b86f-123f5b9eeb99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51] added
Apr 13 17:47:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac4856-c6ef-4755-a1e1-796be16e2f7a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af524add-c8ab-4f68-813a-f7f6a06fa5b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNqACzdw {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNqACzdw" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abc9d63-0459-47bb-85be-f1f6cf56cae5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNqACzdw'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a93b8a9-364d-4755-9d5f-c7da59e2a669]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c7e3b-087d-4edd-91fc-9f6c11feeb44]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:47:13 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:47:13 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:47:13 user nova-compute[71354]: 
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[485caa03-2fa9-4876-8343-26e30a41fdaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260]
Apr 13 17:47:13 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5a52a-7a19-450b-b0e6-36513c6d28ba]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff569c-4893-4a40-843e-d6f7903649b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d5488d-52de-4ecd-8039-7deedd5f588e]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNqACzdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:47:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Creating image(s)
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Ensure instance console log exists: /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Start _get_guest_xml network_info=[{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'a10acc04-0f75-4fa4-ab31-27d70d34506f', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKkoSsRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad14d742-a995-4eab-bc37-d04d3c20c170', 'attached_at': '', 'detached_at': '', 'volume_id': '267ae4b0-e7ad-4ed8-abec-00760971ce21', 'serial': '267ae4b0-e7ad-4ed8-abec-00760971ce21'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': 'f1871334-6cb8-42ad-9a26-303015f106da', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOLSQFmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad14d742-a995-4eab-bc37-d04d3c20c170', 'attached_at': '', 'detached_at': '', 'volume_id': '76bf1eb0-235d-4aec-8895-594830d9b8ce', 'serial': '76bf1eb0-235d-4aec-8895-594830d9b8ce'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': '4217dc9a-0cc2-43a5-b841-a89752c54216', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDhrKedj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad14d742-a995-4eab-bc37-d04d3c20c170', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb71648a-a496-4b94-a14e-061f9eb3b3db', 'serial': 'eb71648a-a496-4b94-a14e-061f9eb3b3db'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:47:14 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:14 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKkoSsRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:14 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23333363662633639', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333363662633639', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.417s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:14 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:14 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76221f-3594-4be4-b6f5-8c463bd851af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:14 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBbqQyRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:14 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f039d000-6a89-483f-b578-a35293a009b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21] added
Apr 13 17:47:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2198e3f-7eee-4227-a38a-a5f4063670ff]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f435e9-e797-4f06-8186-ea5b9559843b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKkoSsRH {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKkoSsRH" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25b829-b3ea-4f28-8076-14c467f37654]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKkoSsRH'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d39e3a-75cd-4427-b440-337bb0b6dd04]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d89bc7-d489-4a96-acc7-9e6887ae44be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29a2db-6437-476d-86df-7914ca71c89c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260]
Apr 13 17:47:15 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:15 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd8b13-f09e-47e7-8a7e-3cbb5ca00a95]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf68610-6b3b-403b-bbe8-af3857896fbb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:15 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:15 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:15 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:15 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77893f8-bdba-4b38-b4af-c6304cd92dc2]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKkoSsRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== connect_volume: return (1719ms) {'type': 'block', 'scsi_wwn': '23763353338383233', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763353338383233', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.270s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:16 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:16 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97939f-5d69-4ff7-849f-0036f0a94173]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:16 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOLSQFmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:16 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6843e5-5e0c-41da-8dc5-f1bb85812f7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e] added
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ebad2b-3978-4af6-8720-31b58a04095d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fd24f1-69f2-41bc-a308-b7b897b00ae0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBbqQyRE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBbqQyRE" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76069461-77b2-4152-83f4-eff7120f44b9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBbqQyRE'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef525be-45cf-4a45-a72b-c71f944968bc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aae47c-029e-413f-99f2-3d5908f40fc3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[746731bf-a91b-4c75-89aa-3688948ea4ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260]
Apr 13 17:47:16 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2592b1e9-5032-47a2-a9e7-ef80d9b58f22]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdc19e7-c6bc-4db5-b7ad-8145cca02bbb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:16 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d199b2a9-18a0-47af-bb2b-b727caa1e794]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBbqQyRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== connect_volume: return (2634ms) {'type': 'block', 'scsi_wwn': '23566343464363966', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566343464363966', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.337s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:17 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:17 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b4ad45-0aaf-4dd7-a8b7-cb2f2403a72e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:17 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwlsntAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:17 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185d6b5-df92-4ab9-825b-07b43460b626]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce] added
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2eb75-a0d5-4c0c-a88d-7fecdeff8fe6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[436cc7e2-6754-49e6-8f80-3893712077cd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOLSQFmU {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wOLSQFmU" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73af1d-b2b6-4c06-8920-dfe60ee4a691]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wOLSQFmU'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2f742e-4dc1-4de9-bf0b-9ef58ad8c95a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54201ec5-f00c-4fc9-ac74-0dd9f843aa8a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042d259-5756-4eac-bfec-06a440daa99b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260]
Apr 13 17:47:17 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a229b-e15d-467b-926f-11e5956c1beb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a2868-ae37-4481-825d-c8d323d33c83]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:17 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02267ce-cb32-431e-b5cc-836ca22cc8ee]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOLSQFmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== connect_volume: return (2696ms) {'type': 'block', 'scsi_wwn': '23764333334666564', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764333334666564', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.311s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:18 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:18 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb31bd55-aec8-4968-874d-a1e1dd51f84c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:18 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDhrKedj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:18 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5111f0da-f0c1-43d9-860a-dbdaea62c3ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43] added
Apr 13 17:47:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bceb61a-5b34-44ed-ad92-82210cf56132]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b584d62-ed6f-43fa-80f6-cd53eaa0cb70]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwlsntAz {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwlsntAz" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3502f7-bc99-4988-8081-cc9207770f03]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TwlsntAz'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fefe9b-32d4-4fd0-9938-70b35311812e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e015531c-739b-40ba-91ff-2a44b8bd8c5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c2aac-bd2a-460b-9488-6a70c5f6af9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260]
Apr 13 17:47:19 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb8a16-745e-4372-8d4d-c7729ade7513]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d49192-3e86-43d4-bfd9-e90148f05d8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:19 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b76a06-27d6-4ccd-a6bb-b68a760b0660]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwlsntAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== connect_volume: return (2650ms) {'type': 'block', 'scsi_wwn': '23730333632663766', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730333632663766', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.306s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:20 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003d478-e931-4afb-a4db-8c0699740f7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:20 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lazy-loading 'pci_devices' on Instance uuid 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d8dd6-ac8a-4925-b367-d13e79c66ab2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db] added
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:47:20 user nova-compute[71354]:   <uuid>9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f</uuid>
Apr 13 17:47:20 user nova-compute[71354]:   <name>instance-0000000a</name>
Apr 13 17:47:20 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:47:20 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:47:20 user nova-compute[71354]:   <metadata>
Apr 13 17:47:20 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:47:20 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:name>tempest-device-tagging-server-612269099</nova:name>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:47:13</nova:creationTime>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:47:20 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:47:20 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:owner>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:user uuid="c62d905cbf3043c28a2a0ad2cab40197">tempest-TaggedBootDevicesTest-1780397263-project-member</nova:user>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:project uuid="fff9543b4dea4fe094f886408bfa5865">tempest-TaggedBootDevicesTest-1780397263</nova:project>
Apr 13 17:47:20 user nova-compute[71354]:       </nova:owner>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:47:20 user nova-compute[71354]:       <nova:ports>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="07509622-d164-4038-ba75-5bf6cd52d615">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="7c1cce3f-97ef-437a-8d7a-728cdf0a0b11">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="8a952bca-a9c0-4f7b-a8d5-8639983809cf">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.9" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="c69b7013-5290-4bec-91d4-d1c86c94e982">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.49" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="fc44eb24-78a4-4ead-a4fc-c35b8c943f63">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="09e76676-6015-4205-bd23-b86f896fb6d1">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:         <nova:port uuid="4f9e9206-943a-43f9-a511-18ed9e8b8c40">
Apr 13 17:47:20 user nova-compute[71354]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 17:47:20 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:20 user nova-compute[71354]:       </nova:ports>
Apr 13 17:47:20 user nova-compute[71354]:     </nova:instance>
Apr 13 17:47:20 user nova-compute[71354]:   </metadata>
Apr 13 17:47:20 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:47:20 user nova-compute[71354]:     <system>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="serial">9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f</entry>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="uuid">9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f</entry>
Apr 13 17:47:20 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:47:20 user nova-compute[71354]:     </system>
Apr 13 17:47:20 user nova-compute[71354]:   </sysinfo>
Apr 13 17:47:20 user nova-compute[71354]:   <os>
Apr 13 17:47:20 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:47:20 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:47:20 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:47:20 user nova-compute[71354]:   </os>
Apr 13 17:47:20 user nova-compute[71354]:   <features>
Apr 13 17:47:20 user nova-compute[71354]:     <acpi/>
Apr 13 17:47:20 user nova-compute[71354]:     <apic/>
Apr 13 17:47:20 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:47:20 user nova-compute[71354]:   </features>
Apr 13 17:47:20 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:47:20 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:47:20 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:47:20 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:47:20 user nova-compute[71354]:   </clock>
Apr 13 17:47:20 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:47:20 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:47:20 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:47:20 user nova-compute[71354]:   </cpu>
Apr 13 17:47:20 user nova-compute[71354]:   <devices>
Apr 13 17:47:20 user nova-compute[71354]:     <disk type="file" device="cdrom">
Apr 13 17:47:20 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 17:47:20 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/disk.config"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="hda" bus="ide"/>
Apr 13 17:47:20 user nova-compute[71354]:     </disk>
Apr 13 17:47:20 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:20 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:20 user nova-compute[71354]:       <source dev="/dev/sdb"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <serial>193d8f02-ca54-46d6-896c-694afc0eef51</serial>
Apr 13 17:47:20 user nova-compute[71354]:     </disk>
Apr 13 17:47:20 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:20 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:20 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <serial>d8bbde54-82c8-4365-80db-fc400c9cf78e</serial>
Apr 13 17:47:20 user nova-compute[71354]:     </disk>
Apr 13 17:47:20 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:20 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:20 user nova-compute[71354]:       <source dev="/dev/sdf"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="vdc" bus="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <serial>13ffd808-19cd-4644-b2e5-3a85520a4d43</serial>
Apr 13 17:47:20 user nova-compute[71354]:     </disk>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:db:e6:d9"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tap07509622-d1"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:d4:b7:64"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tap7c1cce3f-97"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:5d:30:ce"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tap8a952bca-a9"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:76:d0:2d"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tapc69b7013-52"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:c2:7d:0b"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tapfc44eb24-78"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:70:e4:2a"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tap09e76676-60"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:20 user nova-compute[71354]:       <mac address="fa:16:3e:54:61:9a"/>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:20 user nova-compute[71354]:       <target dev="tap4f9e9206-94"/>
Apr 13 17:47:20 user nova-compute[71354]:     </interface>
Apr 13 17:47:20 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:47:20 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/console.log" append="off"/>
Apr 13 17:47:20 user nova-compute[71354]:     </serial>
Apr 13 17:47:20 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:47:20 user nova-compute[71354]:     <video>
Apr 13 17:47:20 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:20 user nova-compute[71354]:     </video>
Apr 13 17:47:20 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:47:20 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:47:20 user nova-compute[71354]:     </rng>
Apr 13 17:47:20 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:47:20 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:47:20 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:47:20 user nova-compute[71354]:     </memballoon>
Apr 13 17:47:20 user nova-compute[71354]:   </devices>
Apr 13 17:47:20 user nova-compute[71354]: </domain>
Apr 13 17:47:20 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216b1c6-3c01-4d28-b9ea-78972b169f49]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07509622-d1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07509622-d1, col_values=(('external_ids', {'iface-id': '07509622-d164-4038-ba75-5bf6cd52d615', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:e6:d9', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c1cce3f-97, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c1cce3f-97, col_values=(('external_ids', {'iface-id': '7c1cce3f-97ef-437a-8d7a-728cdf0a0b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:b7:64', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b1a6a-6119-4309-94c2-b712f8ab52dc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDhrKedj {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDhrKedj" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9481f312-2213-45b2-9fe4-14c2c8abf33c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oDhrKedj'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a952bca-a9, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a952bca-a9, col_values=(('external_ids', {'iface-id': '8a952bca-a9c0-4f7b-a8d5-8639983809cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:30:ce', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e770c-1cc0-4681-8d77-3bf6f6d955e6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69b7013-52, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc69b7013-52, col_values=(('external_ids', {'iface-id': 'c69b7013-5290-4bec-91d4-d1c86c94e982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:d0:2d', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53c48d-6e73-48db-9a06-5c99836ba870]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc44eb24-78, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc44eb24-78, col_values=(('external_ids', {'iface-id': 'fc44eb24-78a4-4ead-a4fc-c35b8c943f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:7d:0b', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689772c-c7ac-42a7-97e3-e7f2c5a143fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260]
Apr 13 17:47:20 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09e76676-60, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09e76676-60, col_values=(('external_ids', {'iface-id': '09e76676-6015-4205-bd23-b86f896fb6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:e4:2a', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c7700d-2e24-4edd-9134-6dacfcec97a5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa5e00-7aea-4f4d-bcb9-98ccb6573bcb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:20 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a4f93-1caa-41c2-b453-1809ee43c476]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDhrKedj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9e9206-94, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f9e9206-94, col_values=(('external_ids', {'iface-id': '4f9e9206-943a-43f9-a511-18ed9e8b8c40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:61:9a', 'vm-uuid': '9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:20 user nova-compute[71354]: INFO os_vif [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94')
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] No BDM found with device name hda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] No VIF found with MAC fa:16:3e:db:e6:d9, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] No VIF found with MAC fa:16:3e:c2:7d:0b, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Using config drive
Apr 13 17:47:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Creating config drive at /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/disk.config
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj5350kg2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj5350kg2" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== connect_volume: return (2699ms) {'type': 'block', 'scsi_wwn': '23130366437333935', 'path': '/dev/sdg'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130366437333935', 'path': '/dev/sdg'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lazy-loading 'pci_devices' on Instance uuid ad14d742-a995-4eab-bc37-d04d3c20c170 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:47:21 user nova-compute[71354]:   <uuid>ad14d742-a995-4eab-bc37-d04d3c20c170</uuid>
Apr 13 17:47:21 user nova-compute[71354]:   <name>instance-00000009</name>
Apr 13 17:47:21 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:47:21 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:47:21 user nova-compute[71354]:   <metadata>
Apr 13 17:47:21 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:47:21 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:name>tempest-device-tagging-server-326203077</nova:name>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:47:14</nova:creationTime>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:47:21 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:47:21 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:owner>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:user uuid="4b46c336863a41f8a8429fdad30297a0">tempest-TaggedBootDevicesTest_v242-354774172-project-member</nova:user>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:project uuid="b192b3270576450b8c39368f07d1fae2">tempest-TaggedBootDevicesTest_v242-354774172</nova:project>
Apr 13 17:47:21 user nova-compute[71354]:       </nova:owner>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:47:21 user nova-compute[71354]:       <nova:ports>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="054f8815-c1d1-4b57-9018-a34c8e785b80">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="9dd21baf-0c87-4035-817b-3ecf6dad3ec1">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="f454a828-50c6-43ba-ae8b-f2b86adbde6d">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="2968f077-89fd-47b8-b2d8-2be699130a08">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="90e3c9b9-b913-43e7-b7af-72f5ab808b6e">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="7794066e-1eb8-4f57-b683-af981db15421">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:         <nova:port uuid="365ecb91-8df1-419a-b559-ab5f41e6e38f">
Apr 13 17:47:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 17:47:21 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:21 user nova-compute[71354]:       </nova:ports>
Apr 13 17:47:21 user nova-compute[71354]:     </nova:instance>
Apr 13 17:47:21 user nova-compute[71354]:   </metadata>
Apr 13 17:47:21 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:47:21 user nova-compute[71354]:     <system>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="serial">ad14d742-a995-4eab-bc37-d04d3c20c170</entry>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="uuid">ad14d742-a995-4eab-bc37-d04d3c20c170</entry>
Apr 13 17:47:21 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:47:21 user nova-compute[71354]:     </system>
Apr 13 17:47:21 user nova-compute[71354]:   </sysinfo>
Apr 13 17:47:21 user nova-compute[71354]:   <os>
Apr 13 17:47:21 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:47:21 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:47:21 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:47:21 user nova-compute[71354]:   </os>
Apr 13 17:47:21 user nova-compute[71354]:   <features>
Apr 13 17:47:21 user nova-compute[71354]:     <acpi/>
Apr 13 17:47:21 user nova-compute[71354]:     <apic/>
Apr 13 17:47:21 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:47:21 user nova-compute[71354]:   </features>
Apr 13 17:47:21 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:47:21 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:47:21 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:47:21 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:47:21 user nova-compute[71354]:   </clock>
Apr 13 17:47:21 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:47:21 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:47:21 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:47:21 user nova-compute[71354]:   </cpu>
Apr 13 17:47:21 user nova-compute[71354]:   <devices>
Apr 13 17:47:21 user nova-compute[71354]:     <disk type="file" device="cdrom">
Apr 13 17:47:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 17:47:21 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/disk.config"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="hda" bus="ide"/>
Apr 13 17:47:21 user nova-compute[71354]:     </disk>
Apr 13 17:47:21 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:21 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <serial>267ae4b0-e7ad-4ed8-abec-00760971ce21</serial>
Apr 13 17:47:21 user nova-compute[71354]:     </disk>
Apr 13 17:47:21 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:21 user nova-compute[71354]:       <source dev="/dev/sde"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <serial>76bf1eb0-235d-4aec-8895-594830d9b8ce</serial>
Apr 13 17:47:21 user nova-compute[71354]:     </disk>
Apr 13 17:47:21 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:47:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:21 user nova-compute[71354]:       <source dev="/dev/sdg"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="vdc" bus="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <serial>eb71648a-a496-4b94-a14e-061f9eb3b3db</serial>
Apr 13 17:47:21 user nova-compute[71354]:     </disk>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:e2:c7:67"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap054f8815-c1"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:cf:6f:fb"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap9dd21baf-0c"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:fe:6f:d9"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tapf454a828-50"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:29:eb:c4"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap2968f077-89"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:6f:97:1f"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap90e3c9b9-b9"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:53:06:4b"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap7794066e-1e"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:21 user nova-compute[71354]:       <mac address="fa:16:3e:7a:33:33"/>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:21 user nova-compute[71354]:       <target dev="tap365ecb91-8d"/>
Apr 13 17:47:21 user nova-compute[71354]:     </interface>
Apr 13 17:47:21 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:47:21 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/console.log" append="off"/>
Apr 13 17:47:21 user nova-compute[71354]:     </serial>
Apr 13 17:47:21 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:47:21 user nova-compute[71354]:     <video>
Apr 13 17:47:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:21 user nova-compute[71354]:     </video>
Apr 13 17:47:21 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:47:21 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:47:21 user nova-compute[71354]:     </rng>
Apr 13 17:47:21 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:47:21 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:47:21 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:47:21 user nova-compute[71354]:     </memballoon>
Apr 13 17:47:21 user nova-compute[71354]:   </devices>
Apr 13 17:47:21 user nova-compute[71354]: </domain>
Apr 13 17:47:21 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap054f8815-c1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap054f8815-c1, col_values=(('external_ids', {'iface-id': '054f8815-c1d1-4b57-9018-a34c8e785b80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c7:67', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1')
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dd21baf-0c, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dd21baf-0c, col_values=(('external_ids', {'iface-id': '9dd21baf-0c87-4035-817b-3ecf6dad3ec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:6f:fb', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c')
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf454a828-50, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf454a828-50, col_values=(('external_ids', {'iface-id': 'f454a828-50c6-43ba-ae8b-f2b86adbde6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:6f:d9', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50')
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2968f077-89, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2968f077-89, col_values=(('external_ids', {'iface-id': '2968f077-89fd-47b8-b2d8-2be699130a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:eb:c4', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89')
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e3c9b9-b9, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90e3c9b9-b9, col_values=(('external_ids', {'iface-id': '90e3c9b9-b913-43e7-b7af-72f5ab808b6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:97:1f', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9')
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7794066e-1e, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7794066e-1e, col_values=(('external_ids', {'iface-id': '7794066e-1eb8-4f57-b683-af981db15421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:06:4b', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e')
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365ecb91-8d, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap365ecb91-8d, col_values=(('external_ids', {'iface-id': '365ecb91-8df1-419a-b559-ab5f41e6e38f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:33:33', 'vm-uuid': 'ad14d742-a995-4eab-bc37-d04d3c20c170'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: INFO os_vif [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d')
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:22 user nova-compute[71354]: WARNING nova.compute.manager [req-275d01cc-1a43-4394-9c64-c48234879315 req-f4b07c3d-c622-4189-89e8-e3d5ac8fb60b service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 for instance with vm_state building and task_state spawning.
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] No BDM found with device name hda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] No VIF found with MAC fa:16:3e:e2:c7:67, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] No VIF found with MAC fa:16:3e:6f:97:1f, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Using config drive
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Creating config drive at /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/disk.config
Apr 13 17:47:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_jxwy7t3 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_jxwy7t3" returned: 0 in 0.067s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:23 user nova-compute[71354]: WARNING nova.compute.manager [req-72f8d2d0-d354-4853-b540-6cbabd295124 req-dc3103a8-8cb9-4d1a-a398-d533ae97bd9d service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance with vm_state building and task_state spawning.
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:24 user nova-compute[71354]: WARNING nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 for instance with vm_state building and task_state spawning.
Apr 13 17:47:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:24 user nova-compute[71354]: WARNING nova.compute.manager [req-72a6a32b-7bda-4be8-86f3-232cecc11635 req-1880d2cd-3531-4725-b6d2-dd400650d985 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance with vm_state building and task_state spawning.
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:25 user nova-compute[71354]: WARNING nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance with vm_state building and task_state spawning.
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:25 user nova-compute[71354]: WARNING nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance with vm_state building and task_state spawning.
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:25 user nova-compute[71354]: WARNING nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance with vm_state building and task_state spawning.
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:25 user nova-compute[71354]: WARNING nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 for instance with vm_state building and task_state spawning.
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:25 user nova-compute[71354]: WARNING nova.compute.manager [req-bdfcc297-fcb7-4391-9283-4f97fb5d4bdb req-057ce812-ccd4-49d1-9dfd-51c6de811369 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 for instance with vm_state building and task_state spawning.
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:26 user nova-compute[71354]: WARNING nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance with vm_state building and task_state spawning.
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:26 user nova-compute[71354]: WARNING nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 for instance with vm_state building and task_state spawning.
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:26 user nova-compute[71354]: WARNING nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 for instance with vm_state building and task_state spawning.
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:26 user nova-compute[71354]: WARNING nova.compute.manager [req-bc2f7b7c-530d-4008-a85e-73ca45af4973 req-6f8d7502-be01-42eb-a823-8f25de601628 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 for instance with vm_state building and task_state spawning.
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:27 user nova-compute[71354]: WARNING nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance with vm_state building and task_state spawning.
Apr 13 17:47:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:27 user nova-compute[71354]: WARNING nova.compute.manager [req-3ec08e2d-c1df-4c9c-b054-f23cfd5f2402 req-34659aa0-c738-4766-8eba-dfc4a0ab9f55 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance with vm_state building and task_state spawning.
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:28 user nova-compute[71354]: WARNING nova.compute.manager [req-51bbb130-d119-48e9-8ea2-3b500642287e req-f5fbcaaf-129a-4a55-84ed-8ee4944e7734 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 for instance with vm_state building and task_state spawning.
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408049.140927, 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] VM Resumed (Lifecycle Event)
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance spawned successfully.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408049.1440942, 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] VM Started (Lifecycle Event)
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Took 15.97 seconds to spawn the instance on the hypervisor.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:29 user nova-compute[71354]: WARNING nova.compute.manager [req-fb7169c0-82ed-4882-8d9e-5869a53f631a req-75afe58c-6dc7-4076-a10a-d534ee55be7b service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance with vm_state building and task_state spawning.
Apr 13 17:47:29 user nova-compute[71354]: INFO nova.compute.manager [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Took 32.07 seconds to build instance.
Apr 13 17:47:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff2593e2-4468-4d41-b2a4-fae9fe507ade tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.229s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:30 user nova-compute[71354]: WARNING nova.compute.manager [req-ea31d946-e6a0-4586-a833-a9a54801d9ae req-d095edfb-b48b-4663-a945-854031cd5103 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 for instance with vm_state building and task_state spawning.
Apr 13 17:47:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408050.4798615, ad14d742-a995-4eab-bc37-d04d3c20c170 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] VM Resumed (Lifecycle Event)
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance spawned successfully.
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408050.4814303, ad14d742-a995-4eab-bc37-d04d3c20c170 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] VM Started (Lifecycle Event)
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Took 16.30 seconds to spawn the instance on the hypervisor.
Apr 13 17:47:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:30 user nova-compute[71354]: INFO nova.compute.manager [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Took 36.78 seconds to build instance.
Apr 13 17:47:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4b8ee7e-aca9-47e5-8e1b-83c5dee240a2 tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.889s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:31 user nova-compute[71354]: WARNING nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance with vm_state active and task_state None.
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:31 user nova-compute[71354]: WARNING nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f for instance with vm_state active and task_state None.
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:31 user nova-compute[71354]: WARNING nova.compute.manager [req-d5decf08-6442-4bcc-8e9a-d9ab01e375a4 req-4db94e8c-ba26-4b6c-8f88-a6190b33e128 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f for instance with vm_state active and task_state None.
Apr 13 17:47:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:47:33 user nova-compute[71354]: INFO nova.compute.claims [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Claim successful on node user
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:47:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:47:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.policy [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:47:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Creating image(s)
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.virt.images [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] f74a8be6-03b3-48d9-81ef-7d62c11ef0e3 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.part /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.part /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.converted" returned: 0 in 0.194s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Successfully created port: 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.866s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json" returned: 0 in 0.189s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json" returned: 0 in 0.199s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f,backing_fmt=raw /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f,backing_fmt=raw /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk 1073741824" returned: 0 in 0.061s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "cbfdf7211ae48b9917f30439bbdf813f53dea53f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json" returned: 0 in 0.173s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Cannot resize image /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'migration_context' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Successfully updated port: 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Ensure instance console log exists: /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing instance network info cache due to event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance network_info: |[{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start _get_guest_xml network_info=[{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:47:30Z,direct_url=<?>,disk_format='qcow2',id=f74a8be6-03b3-48d9-81ef-7d62c11ef0e3,min_disk=0,min_ram=0,name='tempest-scenario-img--164211581',owner='88bc3754064947c89397db4a80161b3a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:47:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'f74a8be6-03b3-48d9-81ef-7d62c11ef0e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:47:36 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:36 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:47:30Z,direct_url=<?>,disk_format='qcow2',id=f74a8be6-03b3-48d9-81ef-7d62c11ef0e3,min_disk=0,min_ram=0,name='tempest-scenario-img--164211581',owner='88bc3754064947c89397db4a80161b3a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:47:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:47:34Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'pci_devices' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:47:36 user nova-compute[71354]:   <uuid>832e4b85-2c48-469d-a21e-c56cccfcabe4</uuid>
Apr 13 17:47:36 user nova-compute[71354]:   <name>instance-0000000b</name>
Apr 13 17:47:36 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:47:36 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:47:36 user nova-compute[71354]:   <metadata>
Apr 13 17:47:36 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:47:36 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:name>tempest-TestMinimumBasicScenario-server-652760998</nova:name>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:47:36</nova:creationTime>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:47:36 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:47:36 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:owner>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:user uuid="8bdac67b9cc149b4b802c96fc87fc801">tempest-TestMinimumBasicScenario-1587858147-project-member</nova:user>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:project uuid="88bc3754064947c89397db4a80161b3a">tempest-TestMinimumBasicScenario-1587858147</nova:project>
Apr 13 17:47:36 user nova-compute[71354]:       </nova:owner>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:root type="image" uuid="f74a8be6-03b3-48d9-81ef-7d62c11ef0e3"/>
Apr 13 17:47:36 user nova-compute[71354]:       <nova:ports>
Apr 13 17:47:36 user nova-compute[71354]:         <nova:port uuid="7c1fde03-37b1-418b-8a56-9d046c05a1e0">
Apr 13 17:47:36 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:47:36 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:36 user nova-compute[71354]:       </nova:ports>
Apr 13 17:47:36 user nova-compute[71354]:     </nova:instance>
Apr 13 17:47:36 user nova-compute[71354]:   </metadata>
Apr 13 17:47:36 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:47:36 user nova-compute[71354]:     <system>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="serial">832e4b85-2c48-469d-a21e-c56cccfcabe4</entry>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="uuid">832e4b85-2c48-469d-a21e-c56cccfcabe4</entry>
Apr 13 17:47:36 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:47:36 user nova-compute[71354]:     </system>
Apr 13 17:47:36 user nova-compute[71354]:   </sysinfo>
Apr 13 17:47:36 user nova-compute[71354]:   <os>
Apr 13 17:47:36 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:47:36 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:47:36 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:47:36 user nova-compute[71354]:   </os>
Apr 13 17:47:36 user nova-compute[71354]:   <features>
Apr 13 17:47:36 user nova-compute[71354]:     <acpi/>
Apr 13 17:47:36 user nova-compute[71354]:     <apic/>
Apr 13 17:47:36 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:47:36 user nova-compute[71354]:   </features>
Apr 13 17:47:36 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:47:36 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:47:36 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:47:36 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:47:36 user nova-compute[71354]:   </clock>
Apr 13 17:47:36 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:47:36 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:47:36 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:47:36 user nova-compute[71354]:   </cpu>
Apr 13 17:47:36 user nova-compute[71354]:   <devices>
Apr 13 17:47:36 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:47:36 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:47:36 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk"/>
Apr 13 17:47:36 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:47:36 user nova-compute[71354]:     </disk>
Apr 13 17:47:36 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:36 user nova-compute[71354]:       <mac address="fa:16:3e:d3:be:f6"/>
Apr 13 17:47:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:36 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:36 user nova-compute[71354]:       <target dev="tap7c1fde03-37"/>
Apr 13 17:47:36 user nova-compute[71354]:     </interface>
Apr 13 17:47:36 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:47:36 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/console.log" append="off"/>
Apr 13 17:47:36 user nova-compute[71354]:     </serial>
Apr 13 17:47:36 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:47:36 user nova-compute[71354]:     <video>
Apr 13 17:47:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:36 user nova-compute[71354]:     </video>
Apr 13 17:47:36 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:47:36 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:47:36 user nova-compute[71354]:     </rng>
Apr 13 17:47:36 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:47:36 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:47:36 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:47:36 user nova-compute[71354]:     </memballoon>
Apr 13 17:47:36 user nova-compute[71354]:   </devices>
Apr 13 17:47:36 user nova-compute[71354]: </domain>
Apr 13 17:47:36 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:47:34Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG os_vif [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c1fde03-37, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c1fde03-37, col_values=(('external_ids', {'iface-id': '7c1fde03-37b1-418b-8a56-9d046c05a1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:be:f6', 'vm-uuid': '832e4b85-2c48-469d-a21e-c56cccfcabe4'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:36 user nova-compute[71354]: INFO os_vif [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37')
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No VIF found with MAC fa:16:3e:d3:be:f6, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updated VIF entry in instance network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2741ccfb-52ae-4fcc-94dc-c7f155af5978 req-c3e5628f-dac1-4ed8-bd9a-5e5fc32c79df service nova] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:38 user nova-compute[71354]: WARNING nova.compute.manager [req-876e67cc-b85c-472c-beb9-76b24dd1b00e req-80c1e46e-d431-4de6-9e9d-9b5beae46c36 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state building and task_state spawning.
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408060.3393857, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] VM Resumed (Lifecycle Event)
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance spawned successfully.
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408060.342503, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] VM Started (Lifecycle Event)
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:40 user nova-compute[71354]: WARNING nova.compute.manager [req-bec8ecda-3d84-487b-bffb-d643d423a9af req-a9c6ee3e-f8ca-4b37-ab50-c5f438e1d069 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state building and task_state spawning.
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 13 17:47:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:40 user nova-compute[71354]: INFO nova.compute.manager [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Took 7.35 seconds to build instance.
Apr 13 17:47:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1395c71d-ebdc-4003-bf66-11af25b15c60 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.486s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:47:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lazy-loading 'flavor' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:43 user nova-compute[71354]: INFO nova.compute.manager [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Attaching volume 916775cf-a7af-491f-b7ea-3c1b57369f17 to /dev/vdb
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.utils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15642915-b028-4e99-a6ce-a7d5bdde9843]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c5a222-a3ee-4969-80e9-f51cc463a91f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f076241-2ea8-46e1-ac1e-000d9e73177d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dacfe4-436a-40d6-9409-a53b91cb5e91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:47:43 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c057a72-6ebe-4bca-9881-dcfeecc9c405]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG os_brick.utils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating existing volume attachment record: 85d1a0c3-41d1-4200-9622-bf8584aec78a {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:47:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:47 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:47 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7346MB free_disk=26.526416778564453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1a1b241a-4461-41d9-8890-012ddbda76df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ad14d742-a995-4eab-bc37-d04d3c20c170 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:47:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.242s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:47:48 user nova-compute[71354]: INFO nova.compute.claims [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Claim successful on node user
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:47:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCgzTPXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:48 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:48 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:48 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b008f295-053a-4097-a582-67f281b32d09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:47:48 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.policy [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b33d4309055340a4b42df540ca62d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fbca3daa10432c8abf5e8cc0dff050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0d59f-3361-481c-8d71-c505275728d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17] added
Apr 13 17:47:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:47:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Creating image(s)
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "/opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "/opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "/opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c287890-cdec-4829-bf34-231975fcc432]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80ebebb-22f0-4378-9eab-a8c3e21d56a0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCgzTPXl {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCgzTPXl" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d426135a-5cd8-4ef2-8fc2-d23f84bce443]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCgzTPXl'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9669b6-e766-4f33-9ed2-3fa69de3a83a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab4c85-cd5c-442c-a8b6-01873907299d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ef0725-c288-41ac-8b55-11ae20ca3595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260]
Apr 13 17:47:49 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e775e6-5e70-40f3-b39e-f8fd5c1b9c5c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084099b-8b0f-41ee-a47d-ca0c25555e94]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:49 user nova-compute[71354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)
Apr 13 17:47:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk 1073741824" returned: 0 in 0.046s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78457c37-06ef-4b96-862b-7fe105b236d5]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCgzTPXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Cannot resize image /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'migration_context' on Instance uuid 0243764f-846b-4675-9ea1-49d07b05cdb5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Ensure instance console log exists: /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:49 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Successfully created port: cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26661643532333332', 'path': '/dev/sdh'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661643532333332', 'path': '/dev/sdh'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lazy-loading 'flavor' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Successfully updated port: cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:47:50 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:47:50 user nova-compute[71354]:   <source dev="/dev/sdh"/>
Apr 13 17:47:50 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:47:50 user nova-compute[71354]:   <serial>916775cf-a7af-491f-b7ea-3c1b57369f17</serial>
Apr 13 17:47:50 user nova-compute[71354]: </disk>
Apr 13 17:47:50 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquired lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-changed-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Refreshing instance network info cache due to event network-changed-cb49c554-4ee4-463a-9556-318e3aae8a0f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Acquiring lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Updating instance_info_cache with network_info: [{"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Releasing lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Instance network_info: |[{"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Acquired lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.neutron [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Refreshing network info cache for port cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Start _get_guest_xml network_info=[{"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:47:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-199077965',display_name='tempest-ServersNegativeTestJSON-server-199077965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-199077965',id=12,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-yijoojco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:47:49Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=0243764f-846b-4675-9ea1-49d07b05cdb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'pci_devices' on Instance uuid 0243764f-846b-4675-9ea1-49d07b05cdb5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:47:50 user nova-compute[71354]:   <uuid>0243764f-846b-4675-9ea1-49d07b05cdb5</uuid>
Apr 13 17:47:50 user nova-compute[71354]:   <name>instance-0000000c</name>
Apr 13 17:47:50 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:47:50 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:47:50 user nova-compute[71354]:   <metadata>
Apr 13 17:47:50 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:47:50 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:name>tempest-ServersNegativeTestJSON-server-199077965</nova:name>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:47:50</nova:creationTime>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:47:50 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:47:50 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:owner>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:user uuid="b33d4309055340a4b42df540ca62d59f">tempest-ServersNegativeTestJSON-238465742-project-member</nova:user>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:project uuid="b4fbca3daa10432c8abf5e8cc0dff050">tempest-ServersNegativeTestJSON-238465742</nova:project>
Apr 13 17:47:50 user nova-compute[71354]:       </nova:owner>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:47:50 user nova-compute[71354]:       <nova:ports>
Apr 13 17:47:50 user nova-compute[71354]:         <nova:port uuid="cb49c554-4ee4-463a-9556-318e3aae8a0f">
Apr 13 17:47:50 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:47:50 user nova-compute[71354]:         </nova:port>
Apr 13 17:47:50 user nova-compute[71354]:       </nova:ports>
Apr 13 17:47:50 user nova-compute[71354]:     </nova:instance>
Apr 13 17:47:50 user nova-compute[71354]:   </metadata>
Apr 13 17:47:50 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:47:50 user nova-compute[71354]:     <system>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="serial">0243764f-846b-4675-9ea1-49d07b05cdb5</entry>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="uuid">0243764f-846b-4675-9ea1-49d07b05cdb5</entry>
Apr 13 17:47:50 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:47:50 user nova-compute[71354]:     </system>
Apr 13 17:47:50 user nova-compute[71354]:   </sysinfo>
Apr 13 17:47:50 user nova-compute[71354]:   <os>
Apr 13 17:47:50 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:47:50 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:47:50 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:47:50 user nova-compute[71354]:   </os>
Apr 13 17:47:50 user nova-compute[71354]:   <features>
Apr 13 17:47:50 user nova-compute[71354]:     <acpi/>
Apr 13 17:47:50 user nova-compute[71354]:     <apic/>
Apr 13 17:47:50 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:47:50 user nova-compute[71354]:   </features>
Apr 13 17:47:50 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:47:50 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:47:50 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:47:50 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:47:50 user nova-compute[71354]:   </clock>
Apr 13 17:47:50 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:47:50 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:47:50 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:47:50 user nova-compute[71354]:   </cpu>
Apr 13 17:47:50 user nova-compute[71354]:   <devices>
Apr 13 17:47:50 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:47:50 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:47:50 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk"/>
Apr 13 17:47:50 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:47:50 user nova-compute[71354]:     </disk>
Apr 13 17:47:50 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:47:50 user nova-compute[71354]:       <mac address="fa:16:3e:68:8a:28"/>
Apr 13 17:47:50 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:50 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:47:50 user nova-compute[71354]:       <target dev="tapcb49c554-4e"/>
Apr 13 17:47:50 user nova-compute[71354]:     </interface>
Apr 13 17:47:50 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:47:50 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/console.log" append="off"/>
Apr 13 17:47:50 user nova-compute[71354]:     </serial>
Apr 13 17:47:50 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:47:50 user nova-compute[71354]:     <video>
Apr 13 17:47:50 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:47:50 user nova-compute[71354]:     </video>
Apr 13 17:47:50 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:47:50 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:47:50 user nova-compute[71354]:     </rng>
Apr 13 17:47:50 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:47:50 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:47:50 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:47:50 user nova-compute[71354]:     </memballoon>
Apr 13 17:47:50 user nova-compute[71354]:   </devices>
Apr 13 17:47:50 user nova-compute[71354]: </domain>
Apr 13 17:47:50 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-199077965',display_name='tempest-ServersNegativeTestJSON-server-199077965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-199077965',id=12,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-yijoojco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:47:49Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=0243764f-846b-4675-9ea1-49d07b05cdb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG os_vif [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb49c554-4e, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb49c554-4e, col_values=(('external_ids', {'iface-id': 'cb49c554-4ee4-463a-9556-318e3aae8a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:8a:28', 'vm-uuid': '0243764f-846b-4675-9ea1-49d07b05cdb5'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:50 user nova-compute[71354]: INFO os_vif [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e')
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] No VIF found with MAC fa:16:3e:cb:ae:e6, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] No VIF found with MAC fa:16:3e:68:8a:28, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:47:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec5ccf71-506b-40af-bd2c-c63004b02084 tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.866s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Updated VIF entry in instance network info cache for port cb49c554-4ee4-463a-9556-318e3aae8a0f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Updating instance_info_cache with network_info: [{"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd38d052-a12d-4d7e-9e7d-682b2a26b5b9 req-9ea02fbd-5fd4-4dc7-8264-72b96167f938 service nova] Releasing lock "refresh_cache-0243764f-846b-4675-9ea1-49d07b05cdb5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:52 user nova-compute[71354]: INFO nova.compute.manager [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Terminating instance
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-changed-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Refreshing instance network info cache due to event network-changed-067fbe09-ace1-4188-a99f-ee4847a1a311. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.network.neutron [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Refreshing network info cache for port 067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] No waiting events found dispatching network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:52 user nova-compute[71354]: WARNING nova.compute.manager [req-5bf2f5d7-ed24-479b-a5bd-35e68e6bc651 req-3f9a45e2-bb38-4c40-9099-1d58656ead9f service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received unexpected event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f for instance with vm_state building and task_state spawning.
Apr 13 17:47:53 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Instance destroyed successfully.
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lazy-loading 'resources' on Instance uuid bfcf221f-b53a-4e85-9743-ee10ab3c387c {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-448804682',display_name='tempest-DeleteServersTestJSON-server-448804682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-448804682',id=1,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f4d4b5316fa45838c82ce0a0cfbc3dc',ramdisk_id='',reservation_id='r-h4ankn5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-492033592',owner_user_name='tempest-DeleteServersTestJSON-492033592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:12Z,user_data=None,user_id='772b5f3399f247d191e0f32d386ecea6',uuid=bfcf221f-b53a-4e85-9743-ee10ab3c387c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converting VIF {"id": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "address": "fa:16:3e:cb:ae:e6", "network": {"id": "387b7133-8551-4ab1-845e-7497a2abd8b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-368446067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4d4b5316fa45838c82ce0a0cfbc3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb796c18-e5", "ovs_interfaceid": "cb796c18-e5d5-45de-b1e9-07a5548b8a6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_vif [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb796c18-e5, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:47:53 user nova-compute[71354]: INFO os_vif [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ae:e6,bridge_name='br-int',has_traffic_filtering=True,id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e,network=Network(387b7133-8551-4ab1-845e-7497a2abd8b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb796c18-e5')
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCgzTPXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:47:53 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a714c-465f-45d5-8c03-3fb5eb8cd577]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:47:53 user nova-compute[71354]: No targets found.
Apr 13 17:47:53 user nova-compute[71354]: iSNS:
Apr 13 17:47:53 user nova-compute[71354]: No targets found.
Apr 13 17:47:53 user nova-compute[71354]: STATIC:
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:47:53 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:47:53 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:47:53 user nova-compute[71354]: FIRMWARE:
Apr 13 17:47:53 user nova-compute[71354]: No targets found.
Apr 13 17:47:53 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:47:53 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:47:53 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ce47d-18a3-4ed6-b363-fde2436a18fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.network.neutron [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updated VIF entry in instance network info cache for port 067fbe09-ace1-4188-a99f-ee4847a1a311. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.network.neutron [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.103s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f52c2-d8d6-4f9f-9f86-1bfe45621f65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:47:53 user nova-compute[71354]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 (non-flash)
Apr 13 17:47:53 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da7ef400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17'): ({'sdh'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Removing single pathed devices sdh {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c93fb905-ad15-4a6d-a15c-d6b21e249234 req-52985101-f69d-4db8-827a-864f2d8b83e1 service nova] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af13d7f-79ce-48d8-ae3e-83f9ad2d7fba]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c665e23d-ffbd-4ceb-8e0f-b701d133cf49]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Flushing IO for device /dev/sdh {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.051s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb2ca6-e86a-428d-b076-a3c77a689482]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a3813-6ad5-4c4e-a347-5509ae332b0d]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab0272e-4c94-489c-8ace-c860e7b8add1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[be41580c-0d16-405a-9280-b7eeaf6ff6ad]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260]
Apr 13 17:47:53 user nova-compute[71354]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17, portal: 172.16.0.220,3260] successful.
Apr 13 17:47:53 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916775cf-a7af-491f-b7ea-3c1b57369f17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8861cfe-7263-4d75-b82f-292a903fa2a9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.519s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] <== disconnect_volume: return (521ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:47:53 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Deleting instance files /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c_del
Apr 13 17:47:53 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Deletion of /opt/stack/data/nova/instances/bfcf221f-b53a-4e85-9743-ee10ab3c387c_del complete
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71354) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 17:47:53 user nova-compute[71354]: INFO nova.virt.libvirt.host [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] UEFI support detected
Apr 13 17:47:53 user nova-compute[71354]: INFO nova.compute.manager [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Took 1.50 seconds to destroy the instance on the hypervisor.
Apr 13 17:47:53 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:47:53 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408074.462178, 0243764f-846b-4675-9ea1-49d07b05cdb5 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] VM Resumed (Lifecycle Event)
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Instance spawned successfully.
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408074.4640586, 0243764f-846b-4675-9ea1-49d07b05cdb5 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] VM Started (Lifecycle Event)
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-deleted-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Neutron deleted interface cb796c18-e5d5-45de-b1e9-07a5548b8a6e; detaching it from the instance and deleting it from the info cache
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.network.neutron [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:47:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb0d252a-4b05-43a8-b258-70896527c3ea req-9d16a9e7-55a9-420b-9761-1a9e3a9e033d service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Detach interface failed, port_id=cb796c18-e5d5-45de-b1e9-07a5548b8a6e, reason: Instance bfcf221f-b53a-4e85-9743-ee10ab3c387c could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Took 0.88 seconds to deallocate network for instance.
Apr 13 17:47:54 user nova-compute[71354]: INFO nova.compute.manager [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Took 6.84 seconds to build instance.
Apr 13 17:47:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-069e8e22-68c4-454d-bdf0-2b129517374d tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.936s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] No waiting events found dispatching network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:55 user nova-compute[71354]: WARNING nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received unexpected event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f for instance with vm_state active and task_state None.
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-unplugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] No waiting events found dispatching network-vif-unplugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-unplugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Acquiring lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] No waiting events found dispatching network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:55 user nova-compute[71354]: WARNING nova.compute.manager [req-ac9c5c46-e12c-47dc-8cae-5781e1b065f8 req-eac7b7c6-d941-4050-936e-dc1a9cf43af0 service nova] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Received unexpected event network-vif-plugged-cb796c18-e5d5-45de-b1e9-07a5548b8a6e for instance with vm_state active and task_state deleting.
Apr 13 17:47:55 user nova-compute[71354]: INFO nova.compute.manager [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Took 0.83 seconds to detach 1 volumes for instance.
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:47:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:55 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Deleted allocations for instance bfcf221f-b53a-4e85-9743-ee10ab3c387c
Apr 13 17:47:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1916a730-2b97-4188-bcf1-9e6de9f4e8ca tempest-DeleteServersTestJSON-492033592 tempest-DeleteServersTestJSON-492033592-project-member] Lock "bfcf221f-b53a-4e85-9743-ee10ab3c387c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.875s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:58 user nova-compute[71354]: INFO nova.compute.manager [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Terminating instance
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-unplugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] No waiting events found dispatching network-vif-unplugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-8005554f-ca29-40ba-ac7e-5f92b4743bd7 req-34424526-7892-4ae3-b10f-a7bb6e5a64c0 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-unplugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:47:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Instance destroyed successfully.
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lazy-loading 'resources' on Instance uuid fd435a8f-372c-4aab-81b0-a1f76658b5b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1510345798',display_name='tempest-VolumesActionsTest-instance-1510345798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1510345798',id=4,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a40fa0611d54d5b8a35fcc469fc5361',ramdisk_id='',reservation_id='r-7x0pmhzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1828433590',owner_user_name='tempest-VolumesActionsTest-1828433590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:19Z,user_data=None,user_id='75c1cf6ba73c4adb9124f14d78f4ac16',uuid=fd435a8f-372c-4aab-81b0-a1f76658b5b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converting VIF {"id": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "address": "fa:16:3e:99:54:15", "network": {"id": "9ff6a864-745a-48cf-b5d3-2ea27e2b03fa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-461173952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8a40fa0611d54d5b8a35fcc469fc5361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3a481f-e7", "ovs_interfaceid": "9f3a481f-e7ca-439d-a3da-d13613c9bcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG os_vif [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f3a481f-e7, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:47:58 user nova-compute[71354]: INFO os_vif [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:15,bridge_name='br-int',has_traffic_filtering=True,id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6,network=Network(9ff6a864-745a-48cf-b5d3-2ea27e2b03fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f3a481f-e7')
Apr 13 17:47:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Deleting instance files /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5_del
Apr 13 17:47:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Deletion of /opt/stack/data/nova/instances/fd435a8f-372c-4aab-81b0-a1f76658b5b5_del complete
Apr 13 17:47:58 user nova-compute[71354]: INFO nova.compute.manager [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Took 0.75 seconds to destroy the instance on the hypervisor.
Apr 13 17:47:58 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:47:58 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-deleted-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:47:59 user nova-compute[71354]: INFO nova.compute.manager [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Neutron deleted interface 9f3a481f-e7ca-439d-a3da-d13613c9bcb6; detaching it from the instance and deleting it from the info cache
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.network.neutron [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:47:59 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Took 0.50 seconds to deallocate network for instance.
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-2cbdff03-0f43-4089-89b3-95fb59606fb1 req-ab925912-268c-415e-8d4b-52fbfaa06765 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Detach interface failed, port_id=9f3a481f-e7ca-439d-a3da-d13613c9bcb6, reason: Instance fd435a8f-372c-4aab-81b0-a1f76658b5b5 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:47:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:47:59 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Deleted allocations for instance fd435a8f-372c-4aab-81b0-a1f76658b5b5
Apr 13 17:47:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b3c8d3d5-1f5e-469d-a061-d0ff1f25720f tempest-VolumesActionsTest-1828433590 tempest-VolumesActionsTest-1828433590-project-member] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Acquiring lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] Lock "fd435a8f-372c-4aab-81b0-a1f76658b5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] No waiting events found dispatching network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:00 user nova-compute[71354]: WARNING nova.compute.manager [req-55af839f-31e7-491d-986c-15de47157dce req-e8ba36b0-b356-44bd-a892-657b499c9e28 service nova] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Received unexpected event network-vif-plugged-9f3a481f-e7ca-439d-a3da-d13613c9bcb6 for instance with vm_state deleted and task_state None.
Apr 13 17:48:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing instance network info cache due to event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updated VIF entry in instance network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ac5babb4-94ae-4a89-b94d-26eed0f3619c req-84c9a259-512b-47ae-9c26-1ed0efacaf5c service nova] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:48:07 user nova-compute[71354]: INFO nova.compute.manager [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] instance snapshotting
Apr 13 17:48:07 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Beginning live snapshot process
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26.delta 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26.delta 1073741824" returned: 0 in 0.046s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:07 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 17:48:08 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408073.0113983, bfcf221f-b53a-4e85-9743-ee10ab3c387c => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:48:08 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] VM Stopped (Lifecycle Event)
Apr 13 17:48:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-93e1ad53-11ba-4fe2-8f01-0d238c165444 None None] [instance: bfcf221f-b53a-4e85-9743-ee10ab3c387c] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:48:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 17:48:09 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:48:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26.delta /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26.delta /opt/stack/data/nova/instances/snapshots/tmpp8ct5rjz/ce2f6d37686543b387acad547b88fe26" returned: 0 in 0.263s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Snapshot extracted, beginning image upload
Apr 13 17:48:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Snapshot image upload complete
Apr 13 17:48:11 user nova-compute[71354]: INFO nova.compute.manager [None req-6e0abc12-a755-414b-9cbb-0e88eee4453d tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Took 4.42 seconds to snapshot the instance on the hypervisor.
Apr 13 17:48:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:13 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408078.7471864, fd435a8f-372c-4aab-81b0-a1f76658b5b5 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:48:13 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] VM Stopped (Lifecycle Event)
Apr 13 17:48:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7c942152-b3c7-4481-bba5-97af56efdc3e None None] [instance: fd435a8f-372c-4aab-81b0-a1f76658b5b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:48:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-changed-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Refreshing instance network info cache due to event network-changed-965ec80e-f2ad-4833-b6e7-bd8c13e3973c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Acquiring lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Acquired lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Refreshing network info cache for port 965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updated VIF entry in instance network info cache for port 965ec80e-f2ad-4833-b6e7-bd8c13e3973c. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [{"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3e4d25df-345e-4d8d-99d3-c04909f40f37 req-96c7f9f6-d5be-44f6-87f3-5db6acb284da service nova] Releasing lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'flavor' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:16 user nova-compute[71354]: INFO nova.compute.manager [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Attaching volume 654c81b5-a7f6-4200-8896-6456816b08e3 to /dev/vdb
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.utils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f5bf2-f5a3-46ae-9906-b96207b9e638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f7ba1-afb2-4c2d-a23c-6b85e1037b87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f35b0-4cae-4383-911b-decf5eeeb900]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ca308-ab94-41f6-ae52-f53a5a2ad6b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:16 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24239a-4880-40ec-86c1-f3648becd11f]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG os_brick.utils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating existing volume attachment record: 78dac666-f8d4-4606-b7fc-69e7c39477a1 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-changed-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Refreshing instance network info cache due to event network-changed-d6142a48-379f-470e-aaf0-a2dd0e626d72. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Acquiring lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Acquired lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Refreshing network info cache for port d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updated VIF entry in instance network info cache for port d6142a48-379f-470e-aaf0-a2dd0e626d72. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updating instance_info_cache with network_info: [{"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88d31e53-fabd-445a-bc0e-8766109a42fc req-a5ae3245-8780-4262-b634-b7a6d0dbea81 service nova] Releasing lock "refresh_cache-1a1b241a-4461-41d9-8890-012ddbda76df" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'flavor' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-changed-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Refreshing instance network info cache due to event network-changed-0111f3ea-a151-4ee0-8497-c181f4c2d9dd. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Acquiring lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Acquired lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.network.neutron [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Refreshing network info cache for port 0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'flavor' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:18 user nova-compute[71354]: INFO nova.compute.manager [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Attaching volume 732d0ada-deea-434c-a245-553c2994525f to /dev/sdc
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.utils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6b3507-02b9-42ff-b69c-b59e0f21ea08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91152f3a-edab-402b-ad36-7bab4d515462]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10ffebb-f74e-4ceb-84bd-d5c04f961943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc819fd-75fb-48f7-8124-296edacbabe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:18 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f3720-8817-4f09-8ad8-c56b4953380a]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.utils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updating existing volume attachment record: 8a3a47c2-f591-4194-b5a3-5bec18a3d1ff {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:18 user nova-compute[71354]: INFO nova.compute.manager [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attaching volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb to /dev/vdb
Apr 13 17:48:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.network.neutron [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updated VIF entry in instance network info cache for port 0111f3ea-a151-4ee0-8497-c181f4c2d9dd. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG nova.network.neutron [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating instance_info_cache with network_info: [{"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38bde555-1d2e-402b-80e6-fca3545f7217 req-c2532942-4c84-4cab-9085-35a351866773 service nova] Releasing lock "refresh_cache-fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG os_brick.utils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780a5ab-7374-4fde-9860-f6d758b34a9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eac418-75b5-4464-8ca9-eae4841c4b72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab3995-79a4-4fe1-a9ae-30f4c708a66c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03bae7-b70b-4146-bd5b-622312e34f01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:19 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:48:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a2950-fde4-40a3-bcc0-b474616eedb9]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG os_brick.utils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:19 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating existing volume attachment record: e986cd9b-d888-44c0-80ae-15f32b1f6abf {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:48:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpvVryLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:23 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:23 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:23 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f6e8c-440a-456d-a716-e388f1fa7ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:48:23 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14069c3-322a-4dc6-82bc-9847ce4f8284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f] added
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f5622-5fc9-46c1-9780-c478eae4872f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f59431-2065-4356-b7ee-07429c4f7c1c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpvVryLo {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RpvVryLo" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a17be7-e438-4f71-af09-e69890ab0571]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RpvVryLo'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87073ff0-47de-4df3-b4a8-4761404d4e00]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fde0d3-51f1-44bd-b318-b713ca45d8b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b5d8e7-59e9-4542-b1f9-c84bddfd4feb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260]
Apr 13 17:48:23 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda0d63d-23ba-45ce-ab1d-0949e62d2f7d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a2add-fe3f-426a-a467-0e8a570a4d92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:23 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b008ab-8081-4733-8ed5-ba5976002a03]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpvVryLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRSoxjfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:23 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26335363534636564', 'path': '/dev/sdh'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335363534636564', 'path': '/dev/sdh'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.467s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:24 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:24 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.objects.instance [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'flavor' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[008fe1f4-3589-4d2d-839b-7ee046a34bcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:48:24 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:48:24 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:24 user nova-compute[71354]:   <source dev="/dev/sdh"/>
Apr 13 17:48:24 user nova-compute[71354]:   <target dev="sdc" bus="scsi"/>
Apr 13 17:48:24 user nova-compute[71354]:   <serial>732d0ada-deea-434c-a245-553c2994525f</serial>
Apr 13 17:48:24 user nova-compute[71354]:   <address type="drive" controller="0" unit="2"/>
Apr 13 17:48:24 user nova-compute[71354]: </disk>
Apr 13 17:48:24 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7f3e8-948c-40d5-b13b-964e9bdbcd31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3] added
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c85162-ba63-4723-ba7e-5d270e3d7ac4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86e9f2-6912-41df-a6e8-f5a49f6f6632]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRSoxjfk {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRSoxjfk" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f156d0-3471-4a88-bc3a-e72db0e71c54]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRSoxjfk'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3a551-c8ec-4bfb-9c59-c355339f898c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917ea35-ff88-4f7b-8ddb-fc39795b04df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4db35c-d973-48e4-9705-da4dacfc594d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260]
Apr 13 17:48:24 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e867ff0-0a08-4b7d-bec8-ab37ccc290a9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03058a0b-0977-4485-9ba6-45facdf59b2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:24 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac703f0-c08c-486f-9041-0312c38cf93c]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No BDM found with device name sda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] No VIF found with MAC fa:16:3e:99:fa:bd, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-74644b3e-5cd2-4a88-8f6f-21da909098a0 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.509s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:25 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:25 user nova-compute[71354]: INFO nova.compute.manager [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Detaching volume 732d0ada-deea-434c-a245-553c2994525f
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRSoxjfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] <== connect_volume: return (1806ms) {'type': 'block', 'scsi_wwn': '23431333838336536', 'path': '/dev/sdi'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431333838336536', 'path': '/dev/sdi'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.372s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:25 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:25 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:48:25 user nova-compute[71354]: INFO nova.virt.block_device [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Attempting to driver detach volume 732d0ada-deea-434c-a245-553c2994525f from mountpoint /dev/sdc
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'flavor' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Attempting to detach device sdc from instance 1a1b241a-4461-41d9-8890-012ddbda76df from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:25 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:25 user nova-compute[71354]:   <source dev="/dev/sdh"/>
Apr 13 17:48:25 user nova-compute[71354]:   <target dev="sdc" bus="scsi"/>
Apr 13 17:48:25 user nova-compute[71354]:   <serial>732d0ada-deea-434c-a245-553c2994525f</serial>
Apr 13 17:48:25 user nova-compute[71354]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 17:48:25 user nova-compute[71354]: </disk>
Apr 13 17:48:25 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd81ec3-db22-447f-be57-f89c0020d9e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:48:25 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Successfully detached device sdc from instance 1a1b241a-4461-41d9-8890-012ddbda76df from the persistent domain config.
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1a1b241a-4461-41d9-8890-012ddbda76df from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:25 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:25 user nova-compute[71354]:   <source dev="/dev/sdh"/>
Apr 13 17:48:25 user nova-compute[71354]:   <target dev="sdc" bus="scsi"/>
Apr 13 17:48:25 user nova-compute[71354]:   <serial>732d0ada-deea-434c-a245-553c2994525f</serial>
Apr 13 17:48:25 user nova-compute[71354]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 17:48:25 user nova-compute[71354]: </disk>
Apr 13 17:48:25 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:48:25 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:25 user nova-compute[71354]:   <source dev="/dev/sdi"/>
Apr 13 17:48:25 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:25 user nova-compute[71354]:   <serial>654c81b5-a7f6-4200-8896-6456816b08e3</serial>
Apr 13 17:48:25 user nova-compute[71354]: </disk>
Apr 13 17:48:25 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15feba-4eca-484b-a68a-9b4f1355220b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb] added
Apr 13 17:48:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858be1a-7a23-4dba-a99f-b54e2a00067d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bb0d5b-96d1-47ae-837c-b31d1b759782]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v benChKug {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v benChKug" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26471f8-9119-4f8d-bd26-1e098cb2de55]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'benChKug'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f964efe7-4c26-4452-b766-8765d2400e9f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beb3ff2-6c33-4f5a-bbf1-99b548174bc9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:25 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de8576-b64f-46a7-b3ed-d19baf6f9a38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]
Apr 13 17:48:25 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d89382-371c-437a-ac9a-60aabc59bebd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe534426-4d71-4156-a278-302b814e4846]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:26 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[064d1641-a96c-4201-b46b-c9ee3202bd02]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No VIF found with MAC fa:16:3e:d2:a0:af, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cf956e46-cb20-4944-aded-042a87cb577e tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.747s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408106.412459, 1a1b241a-4461-41d9-8890-012ddbda76df => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:48:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Successfully detached device sdc from instance 1a1b241a-4461-41d9-8890-012ddbda76df from the live domain config.
Apr 13 17:48:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RpvVryLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:26 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] <== connect_volume: return (1721ms) {'type': 'block', 'scsi_wwn': '26637396230663331', 'path': '/dev/sdj'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637396230663331', 'path': '/dev/sdj'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.670s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'flavor' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed2483-d460-4d97-a4e8-7117ba5cb5a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:27 user nova-compute[71354]: No targets found.
Apr 13 17:48:27 user nova-compute[71354]: iSNS:
Apr 13 17:48:27 user nova-compute[71354]: No targets found.
Apr 13 17:48:27 user nova-compute[71354]: STATIC:
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:27 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:27 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:27 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:27 user nova-compute[71354]: No targets found.
Apr 13 17:48:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:27 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:27 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:48:27 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:27 user nova-compute[71354]:   <source dev="/dev/sdj"/>
Apr 13 17:48:27 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:27 user nova-compute[71354]:   <serial>aac82b6d-cb0d-4153-a7e1-8fd1be4167fb</serial>
Apr 13 17:48:27 user nova-compute[71354]: </disk>
Apr 13 17:48:27 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b106ce7-7dd3-4d6e-86d9-06107ab7133c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d532b-8a3a-4f3f-aee0-ca7eda49ee71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:27 user nova-compute[71354]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f (non-flash)
Apr 13 17:48:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d41e8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f'): ({'sdh'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Removing single pathed devices sdh {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda51373-8ea1-4c54-89a8-b3a37694e89b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[126c1750-ac46-48a0-a825-8728ea005514]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Flushing IO for device /dev/sdh {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97df238-8386-490d-afd6-a1b13fb9ac6c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad270dc-bcb5-4a9f-9610-06d4ed946c8d]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a01b64-c7bf-4508-9987-a66ca4812ea4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59262b42-b97c-4e40-a562-26611e1b27a0]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260]
Apr 13 17:48:27 user nova-compute[71354]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732d0ada-deea-434c-a245-553c2994525f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf057e-9a8a-481a-9397-d702efd86f81]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] <== disconnect_volume: return (1026ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] No VIF found with MAC fa:16:3e:5c:b5:5e, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:48:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60df657d-6766-4353-bb9d-5e2c40027bb2 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.843s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:28 user nova-compute[71354]: INFO nova.compute.manager [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Detaching volume 654c81b5-a7f6-4200-8896-6456816b08e3
Apr 13 17:48:28 user nova-compute[71354]: INFO nova.virt.block_device [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Attempting to driver detach volume 654c81b5-a7f6-4200-8896-6456816b08e3 from mountpoint /dev/vdb
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Attempting to detach device vdb from instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:28 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:28 user nova-compute[71354]:   <source dev="/dev/sdi"/>
Apr 13 17:48:28 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:28 user nova-compute[71354]:   <serial>654c81b5-a7f6-4200-8896-6456816b08e3</serial>
Apr 13 17:48:28 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:48:28 user nova-compute[71354]: </disk>
Apr 13 17:48:28 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully detached device vdb from instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 from the persistent domain config.
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:28 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:28 user nova-compute[71354]:   <source dev="/dev/sdi"/>
Apr 13 17:48:28 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:28 user nova-compute[71354]:   <serial>654c81b5-a7f6-4200-8896-6456816b08e3</serial>
Apr 13 17:48:28 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:48:28 user nova-compute[71354]: </disk>
Apr 13 17:48:28 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'flavor' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a4dfc770-ad6b-4809-b217-d6c3f4f2fe2b tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.659s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408108.672038, 85f8857e-9e9b-4a5a-912a-4d79014417d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:48:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully detached device vdb from instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 from the live domain config.
Apr 13 17:48:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRSoxjfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:28 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a72e0-bbee-4c16-bfce-91793b29cde3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:28 user nova-compute[71354]: No targets found.
Apr 13 17:48:28 user nova-compute[71354]: iSNS:
Apr 13 17:48:28 user nova-compute[71354]: No targets found.
Apr 13 17:48:28 user nova-compute[71354]: STATIC:
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:28 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:28 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:28 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:28 user nova-compute[71354]: No targets found.
Apr 13 17:48:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:28 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:28 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e5d072-02b2-4ad7-a455-1ad9cdda5d17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[313792ae-ab72-4faa-bdbb-491bc552b9bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:28 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d41e8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3'): ({'sdi'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Removing single pathed devices sdi {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6355bb-4b2e-49de-b373-b62f2dcfe532]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a15d43-b7a7-4aad-aeb1-77f179b0c6ea]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flushing IO for device /dev/sdi {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a256f6eb-517c-42cb-be98-6562c5898f73]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3d42f6-fc02-4ba0-824a-e8f52f9a0666]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] SCSI volumes sdi have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f377a57d-fbc5-4211-9c12-e0ebb3cb7606]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b940a-ebca-4362-a663-f9a46d0e4716]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260]
Apr 13 17:48:28 user nova-compute[71354]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:654c81b5-a7f6-4200-8896-6456816b08e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745f43b-387e-4280-bfa5-9fc673336d8e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] <== disconnect_volume: return (343ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb4e5c8-0725-4fb6-8377-4ca8dac81a22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a515826-e3cb-4c93-a039-7137a2e365ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f20cda-ceb1-41a7-8272-e20e54cb6d93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf6bb8b-e6b6-4407-b0b3-3ca051a3fba8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:29 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d47ba-d72a-4be5-b29b-a0fcf8ef4601]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:29 user nova-compute[71354]: INFO nova.compute.manager [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Terminating instance
Apr 13 17:48:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:48:29 user nova-compute[71354]: INFO nova.compute.manager [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Swapping volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb for c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-unplugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] No waiting events found dispatching network-vif-unplugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-dfd3b730-2dd0-4d40-93d1-c34d79a38627 req-2a4b42dc-5c81-4a4f-b4b4-8f60d13de1db service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-unplugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Instance destroyed successfully.
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lazy-loading 'resources' on Instance uuid 1a1b241a-4461-41d9-8890-012ddbda76df {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2041945976',display_name='tempest-AttachSCSIVolumeTestJSON-server-2041945976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2041945976',id=7,image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU+SDMniOXw84ibDM7Gr2Fasc8Cy3YObgo+qLbZd0zzuH5EuEl03YcmcoTwxkNgNPk/4Qn+WhACjat3sYKtHXLyw6ONjwOG/Fi6pR193B3tO1ZEkqk3Wu2MsP2bSP51Bg==',key_name='tempest-keypair-1143642649',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='900c1c4928514f198a3b630de0216b60',ramdisk_id='',reservation_id='r-i52k27dv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f64c281-530b-48dc-b419-d28e323bbf14',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-957875763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-957875763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f5fc6a5e3a54d619d57cb94bdb304c5',uuid=1a1b241a-4461-41d9-8890-012ddbda76df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converting VIF {"id": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "address": "fa:16:3e:99:fa:bd", "network": {"id": "a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-70092202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900c1c4928514f198a3b630de0216b60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6142a48-37", "ovs_interfaceid": "d6142a48-379f-470e-aaf0-a2dd0e626d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG os_vif [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6142a48-37, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:30 user nova-compute[71354]: INFO os_vif [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fa:bd,bridge_name='br-int',has_traffic_filtering=True,id=d6142a48-379f-470e-aaf0-a2dd0e626d72,network=Network(a43fa5ed-f0a7-41d6-bf3d-53f7cc9a067c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6142a48-37')
Apr 13 17:48:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Deleting instance files /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df_del
Apr 13 17:48:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Deletion of /opt/stack/data/nova/instances/1a1b241a-4461-41d9-8890-012ddbda76df_del complete
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'flavor' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc76-80e3-403f-9294-9c6ba354ea75 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.052s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:30 user nova-compute[71354]: INFO nova.compute.manager [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 13 17:48:30 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:48:30 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:31 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Took 1.37 seconds to deallocate network for instance.
Apr 13 17:48:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Acquiring lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] Lock "1a1b241a-4461-41d9-8890-012ddbda76df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] No waiting events found dispatching network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:31 user nova-compute[71354]: WARNING nova.compute.manager [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received unexpected event network-vif-plugged-d6142a48-379f-470e-aaf0-a2dd0e626d72 for instance with vm_state active and task_state deleting.
Apr 13 17:48:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4f9eef6-3de9-4a64-988a-7a9dca3defb1 req-298ad2e5-5643-4e77-b0fa-1e0399000d8e service nova] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Received event network-vif-deleted-d6142a48-379f-470e-aaf0-a2dd0e626d72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:48:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:48:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:32 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Deleted allocations for instance 1a1b241a-4461-41d9-8890-012ddbda76df
Apr 13 17:48:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6b171bff-b019-4712-9dca-61f802c28fa2 tempest-AttachSCSIVolumeTestJSON-957875763 tempest-AttachSCSIVolumeTestJSON-957875763-project-member] Lock "1a1b241a-4461-41d9-8890-012ddbda76df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817', 'serial': 'c0363571-bba1-467c-9eb5-2ccf2fcce817'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'serial'} {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:34 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc855a0-9049-48ac-ab5d-e6c6b3a8ac43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:48:34 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3cfa31-e236-428c-b1f3-274e6f356432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817] added
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f04fe2-f203-412b-a6bf-d8872399e7e8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8551c-1c53-4c51-9855-d694fbfe9d3c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeoTILCv {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeoTILCv" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b44416-5153-466f-bd9b-bafcffcec662]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YeoTILCv'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcea7ee-8909-465e-8513-b2ad6d62c7a1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a33e84-e8cc-4e1a-a631-86ae2226d194]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01486231-1eda-4f6b-8c4b-9a94ef9a7e25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260]
Apr 13 17:48:34 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e65585-20e9-4a10-b12a-3714764781b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cbd56c-c367-47f6-a42c-7b7701c0a0c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:34 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ac8f7-3ea4-4a0a-80a1-53d7e9c7b543]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23036393533303064', 'path': '/dev/sdh'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393533303064', 'path': '/dev/sdh'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lazy-loading 'flavor' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 493879296 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 651165696 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 845152256 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:39 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81336bde-ec36-41c0-939c-c1a94974d9ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:39 user nova-compute[71354]: No targets found.
Apr 13 17:48:39 user nova-compute[71354]: iSNS:
Apr 13 17:48:39 user nova-compute[71354]: No targets found.
Apr 13 17:48:39 user nova-compute[71354]: STATIC:
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:39 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:39 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:39 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:39 user nova-compute[71354]: No targets found.
Apr 13 17:48:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:39 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:39 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f0d06-9d17-4cb2-b6ff-58dd8b0ecfd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49dd02-f2d1-4fcb-9882-c597ac8a6fd5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:39 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da6b6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb'): ({'sdj'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Removing single pathed devices sdj {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bf902-e2bf-433b-9ad9-4c258b740530]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4e665-a5b6-4297-8945-c3eef3b1eb2f]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Flushing IO for device /dev/sdj {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71478d-6c3e-486c-aaeb-978edb69f438]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[645de581-1b5e-40f2-8b6d-c1706bed8488]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] SCSI volumes sdj have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1e0b1-c013-4093-b135-cf0c585f856c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c67009-8a35-4b68-b717-3df16f9f7912]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]
Apr 13 17:48:39 user nova-compute[71354]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc550e51-baa4-4272-842f-7f88a448aa25]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== disconnect_volume: return (346ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817', 'serial'} {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 17:48:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: removing Cinder connection for volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 17:48:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: Updating volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YeoTILCv", "auth_password": "NESzL16OQj3xTf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "c0363571-bba1-467c-9eb5-2ccf2fcce817"}, "status": "reserved", "instance": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "attached_at": "", "detached_at": "", "volume_id": "c0363571-bba1-467c-9eb5-2ccf2fcce817", "serial": "c0363571-bba1-467c-9eb5-2ccf2fcce817"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817', 'no_device': None, 'attachment_id': '8ec4da8e-e9e5-4c34-b484-aedffa183446'} {{(pid=71354) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 17:48:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-793b0f14-8b41-4791-97a7-1b77228aeeb4 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.035s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:41 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.utils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ff7a6-0fe3-4f66-a0b1-7f386a4c7f83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606bc4a-2c92-4ad7-904a-8da12e8c2bb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ea639a-8351-43ee-8f1c-9e0e132abfa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f3c7b-34ab-4ae4-91a4-b63d8cc0f145]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:48:42 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec50758-0df6-412e-821e-56f30b1e660b]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG os_brick.utils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:48:42 user nova-compute[71354]: INFO nova.compute.manager [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Swapping volume c0363571-bba1-467c-9eb5-2ccf2fcce817 for aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:48:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408110.0495024, 1a1b241a-4461-41d9-8890-012ddbda76df => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:48:45 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] VM Stopped (Lifecycle Event)
Apr 13 17:48:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-changed-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing instance network info cache due to event network-changed-054f8815-c1d1-4b57-9018-a34c8e785b80. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Acquiring lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Acquired lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG nova.network.neutron [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Refreshing network info cache for port 054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1378da37-4db0-41c6-8253-e376560edef9 None None] [instance: 1a1b241a-4461-41d9-8890-012ddbda76df] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.network.neutron [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updated VIF entry in instance network info cache for port 054f8815-c1d1-4b57-9018-a34c8e785b80. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.network.neutron [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af9d5e55-38c8-41a9-9ca9-0270eafb4a68 req-bf543fec-f987-485e-925b-d6bea805aa73 service nova] Releasing lock "refresh_cache-ad14d742-a995-4eab-bc37-d04d3c20c170" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:46 user nova-compute[71354]: INFO nova.compute.manager [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Terminating instance
Apr 13 17:48:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:48:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'serial': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817'}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817', 'serial'} {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd54f555-11da-492e-90bc-71a5cb06617f req-56a1ba56-b762-490e-99f5-ee689eb8a9bb service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-054f8815-c1d1-4b57-9018-a34c8e785b80 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff71cad7-87cd-41c6-8ffa-bbef8ca695e5 req-3fce6109-0c50-4301-9b52-d28918d347bc service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-7794066e-1eb8-4f57-b683-af981db15421 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:48:49 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7639MB free_disk=26.48897933959961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Instance destroyed successfully.
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lazy-loading 'resources' on Instance uuid ad14d742-a995-4eab-bc37-d04d3c20c170 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87844e-8f87-4a12-95e9-e635e24385d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:48:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap054f8815-c1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be11351-a782-4a94-a472-215774c69587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb] added
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f9279-2c5a-4f61-9aa1-70b8f8a8d8c6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c7:67,bridge_name='br-int',has_traffic_filtering=True,id=054f8815-c1d1-4b57-9018-a34c8e785b80,network=Network(1db53756-cfdb-4e80-a667-e8c0d854e760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054f8815-c1')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3291296-119f-49ca-ae1d-19ea1eefebf5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dd21baf-0c, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v benChKug {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v benChKug" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebd1ec-1d1a-4bfa-8d6b-e196e42db9f0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'benChKug'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc7656b-6463-4b27-bc4b-dc13e4dc9225]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:6f:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dd21baf-0c87-4035-817b-3ecf6dad3ec1,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dd21baf-0c')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf454a828-50, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ad14d742-a995-4eab-bc37-d04d3c20c170 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 0243764f-846b-4675-9ea1-49d07b05cdb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795c1d3-6182-4dd2-b36b-a71c8fec9331]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:6f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f454a828-50c6-43ba-ae8b-f2b86adbde6d,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf454a828-50')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2968f077-89, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-054f8815-c1d1-4b57-9018-a34c8e785b80 for instance with vm_state active and task_state deleting.
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-9dd21baf-0c87-4035-817b-3ecf6dad3ec1 for instance with vm_state active and task_state deleting.
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-f454a828-50c6-43ba-ae8b-f2b86adbde6d for instance with vm_state active and task_state deleting.
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c517b20-a701-471d-a989-b2f5acbd5e87 req-aafe261c-e47b-42a8-a6c5-5866d76af95e service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-2968f077-89fd-47b8-b2d8-2be699130a08 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:eb:c4,bridge_name='br-int',has_traffic_filtering=True,id=2968f077-89fd-47b8-b2d8-2be699130a08,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2968f077-89')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "address": "fa:16:3e:6f:97:1f", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e3c9b9-b9", "ovs_interfaceid": "90e3c9b9-b913-43e7-b7af-72f5ab808b6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e3c9b9-b9, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5829fb-1ccd-43e9-8c5f-09092f14ccbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]
Apr 13 17:48:49 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:97:1f,bridge_name='br-int',has_traffic_filtering=True,id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e,network=Network(644e4ae4-6cea-480d-8625-7375da83264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e3c9b9-b9')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7794066e-1e, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:06:4b,bridge_name='br-int',has_traffic_filtering=True,id=7794066e-1eb8-4f57-b683-af981db15421,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7794066e-1e')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-326203077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-326203077',id=9,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCM/EzqXEQw5+IknMkpZEc8XjwVBO6cXDU4iVlnuvcAg0sGsnvtjYwtUFrsdmckJrjBDU8L9mIIB2dPao1dj8ZA6cxAFugoMxTG4pfWKwt+/4+N0T4gxpAeK6LR2Hh0pg==',key_name='tempest-keypair-1843115864',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b192b3270576450b8c39368f07d1fae2',ramdisk_id='',reservation_id='r-y16zosy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354774172',owner_user_name='tempest-TaggedBootDevicesTest_v242-354774172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b46c336863a41f8a8429fdad30297a0',uuid=ad14d742-a995-4eab-bc37-d04d3c20c170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converting VIF {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5e8946-8c98-4325-90a5-37c137c6d846]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365ecb91-8d, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:49 user nova-compute[71354]: INFO os_vif [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:33:33,bridge_name='br-int',has_traffic_filtering=True,id=365ecb91-8df1-419a-b559-ab5f41e6e38f,network=Network(d6076dd0-0264-48f6-aa40-b5f348cb1d21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365ecb91-8d')
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKkoSsRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b61066a-9cf9-48f0-a854-cd23d156c5f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:49 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c18d8d-71ee-4790-a3a6-8580153a0b55]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:48:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:50 user nova-compute[71354]: WARNING nova.compute.manager [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-7794066e-1eb8-4f57-b683-af981db15421 for instance with vm_state active and task_state deleting.
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-changed-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing instance network info cache due to event network-changed-07509622-d164-4038-ba75-5bf6cd52d615. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Acquiring lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Acquired lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.network.neutron [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Refreshing network info cache for port 07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26637396230663331', 'path': '/dev/sdi'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637396230663331', 'path': '/dev/sdi'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.069s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lazy-loading 'flavor' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ce7be-52e5-444c-8670-e73308a914aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:50 user nova-compute[71354]: No targets found.
Apr 13 17:48:50 user nova-compute[71354]: iSNS:
Apr 13 17:48:50 user nova-compute[71354]: No targets found.
Apr 13 17:48:50 user nova-compute[71354]: STATIC:
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:50 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:50 user nova-compute[71354]: No targets found.
Apr 13 17:48:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:50 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:50 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd12735-9c90-4aef-879a-f40a9d1fb85e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139a43c-b3eb-4d9f-83ad-ee41e403f4cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:50 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da786560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27ba63e-0c82-4fd5-8031-1ca73f02b4a5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[334256e9-2a4c-474a-8362-fe6fdf77b69c]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e01421-d4e4-4aa8-a09b-c0e7bbf50ffa]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9424d7-37c1-4e67-b113-95718952f9df]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d403c8-1070-4639-852d-65d282c015de]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d4a6cf-203f-4fe6-968f-89ac1e3e5e06]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260]
Apr 13 17:48:51 user nova-compute[71354]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:267ae4b0-e7ad-4ed8-abec-00760971ce21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56abc9-ee00-40b5-9fe9-98c1813fada6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== disconnect_volume: return (1439ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wOLSQFmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updated VIF entry in instance network info cache for port 07509622-d164-4038-ba75-5bf6cd52d615. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e296aa56-72bb-49d9-857f-a67687283b2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]: iSNS:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]: STATIC:
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:51 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:51 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4fbbf8f-9d02-4f1d-8985-2f2dacac9d37 req-bc9e9fbc-2b22-40d4-8131-1d99240dbf49 service nova] Releasing lock "refresh_cache-9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a47486-df89-4d5c-b785-671f38b656dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0830f-8404-4c76-9dbd-b8fde973c31c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da766830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe42c6b-ec87-4ab5-beb5-59864b1893b1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e1a55-de73-4ef2-a9eb-ce93e842400f]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092b34d-2a0e-4e02-ab15-7a39f2581dc3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553fdd4-df5e-407d-a96d-e6dbf35a5abc]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.069s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf7596-ead0-4c0f-a312-507f916d5a8a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a8173b-3225-4645-ae52-044d79366112]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260]
Apr 13 17:48:51 user nova-compute[71354]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76bf1eb0-235d-4aec-8895-594830d9b8ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e00a3-2872-4d38-ab67-4f3fbf1d6fc4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== disconnect_volume: return (480ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDhrKedj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[619afeca-ef5c-4d86-8ec1-ab16faa24e50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]: iSNS:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]: STATIC:
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:51 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:51 user nova-compute[71354]: No targets found.
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:51 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:51 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:51 user nova-compute[71354]: WARNING nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-2968f077-89fd-47b8-b2d8-2be699130a08 for instance with vm_state active and task_state deleting.
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:51 user nova-compute[71354]: WARNING nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-90e3c9b9-b913-43e7-b7af-72f5ab808b6e for instance with vm_state active and task_state deleting.
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-unplugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-unplugged-365ecb91-8df1-419a-b559-ab5f41e6e38f for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Acquiring lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] No waiting events found dispatching network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:51 user nova-compute[71354]: WARNING nova.compute.manager [req-64c60a56-a34f-4024-bade-8331af442d0e req-91869d6f-0a17-424a-894a-11a564dd5a61 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received unexpected event network-vif-plugged-365ecb91-8df1-419a-b559-ab5f41e6e38f for instance with vm_state active and task_state deleting.
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727bcb5-5332-47ad-867c-87c7c1ccfb2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec41839-bc70-48d0-9239-6b09f0d5ae15]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:51 user nova-compute[71354]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db (non-flash)
Apr 13 17:48:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d41eb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db'): ({'sdg'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Removing single pathed devices sdg {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc212cc2-615d-4a9e-9f8d-452c033c6ee1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e6fc0-eb78-4572-a672-dd5038c92003]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Flushing IO for device /dev/sdg {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e87f2-c06a-4878-acc0-f5dbe7a3c6d1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.068s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5137b4fd-5b35-444f-9d0d-75b241d12629]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[961a0e03-ddbb-4511-b25d-d5c71bcb82ca]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:52 user nova-compute[71354]: INFO nova.compute.manager [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Terminating instance
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[377670dd-9f64-44d0-8fc2-fcaa48df565a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260]
Apr 13 17:48:52 user nova-compute[71354]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb71648a-a496-4b94-a14e-061f9eb3b3db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369cdfa-b390-4e16-932b-fa45ea09319f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.502s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] <== disconnect_volume: return (504ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:52 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Deleting instance files /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170_del
Apr 13 17:48:52 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Deletion of /opt/stack/data/nova/instances/ad14d742-a995-4eab-bc37-d04d3c20c170_del complete
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: INFO nova.compute.manager [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Took 5.29 seconds to destroy the instance on the hypervisor.
Apr 13 17:48:52 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 444596224 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 606076928 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff26e36f-68d2-4b2e-b729-b84f2c2aa101 req-e61b203d-8156-406e-8af8-8b66ddc67996 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-07509622-d164-4038-ba75-5bf6cd52d615 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:53 user nova-compute[71354]: WARNING nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-07509622-d164-4038-ba75-5bf6cd52d615 for instance with vm_state active and task_state deleting.
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-98c16756-4374-4629-9e10-6c1378380b5e req-5af3f8fb-392d-4945-b82e-2a81f7757a98 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:54 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Instance destroyed successfully.
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.objects.instance [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lazy-loading 'resources' on Instance uuid 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07509622-d1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:e6:d9,bridge_name='br-int',has_traffic_filtering=True,id=07509622-d164-4038-ba75-5bf6cd52d615,network=Network(61e4464a-644e-4c8f-b177-341dae607f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07509622-d1')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c1cce3f-97, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=7c1cce3f-97ef-437a-8d7a-728cdf0a0b11,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7c1cce3f-97')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a952bca-a9, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 933232640 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:30:ce,bridge_name='br-int',has_traffic_filtering=True,id=8a952bca-a9c0-4f7b-a8d5-8639983809cf,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a952bca-a9')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69b7013-52, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=c69b7013-5290-4bec-91d4-d1c86c94e982,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69b7013-52')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc44eb24-78, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7d:0b,bridge_name='br-int',has_traffic_filtering=True,id=fc44eb24-78a4-4ead-a4fc-c35b8c943f63,network=Network(2871b866-1912-4fea-a7f2-c68b85ddfc2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc44eb24-78')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09e76676-60, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e4:2a,bridge_name='br-int',has_traffic_filtering=True,id=09e76676-6015-4205-bd23-b86f896fb6d1,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e76676-60')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-612269099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-612269099',id=10,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIjrSv+hkXGppUYwuvl8+O7OdVHIMe/AdN6VgG71QJiGEtz8icSglR7q4a311s2aKTDC8hOnBDDcBIaHui5y3NwwO8AvHpzWoHtR/Xq5pXws7YnNwduyvxoIeRVoqvEMw==',key_name='tempest-keypair-1897677956',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fff9543b4dea4fe094f886408bfa5865',ramdisk_id='',reservation_id='r-rn122djj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1780397263',owner_user_name='tempest-TaggedBootDevicesTest-1780397263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c62d905cbf3043c28a2a0ad2cab40197',uuid=9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converting VIF {"id": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "address": "fa:16:3e:54:61:9a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9206-94", "ovs_interfaceid": "4f9e9206-943a-43f9-a511-18ed9e8b8c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9e9206-94, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:48:54 user nova-compute[71354]: INFO os_vif [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:61:9a,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9206-943a-43f9-a511-18ed9e8b8c40,network=Network(47107af9-74a2-4df2-bcec-08f68c7d62ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9206-94')
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNqACzdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:54 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97439dba-bd5d-47f8-9944-6be5c4e1078b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:54 user nova-compute[71354]: No targets found.
Apr 13 17:48:54 user nova-compute[71354]: iSNS:
Apr 13 17:48:54 user nova-compute[71354]: No targets found.
Apr 13 17:48:54 user nova-compute[71354]: STATIC:
Apr 13 17:48:54 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:54 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:54 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:54 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:54 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:54 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:54 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51
Apr 13 17:48:54 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:54 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:54 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:54 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:54 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:54 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:54 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:54 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:54 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:54 user nova-compute[71354]: No targets found.
Apr 13 17:48:54 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:54 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:54 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa0634-668c-424d-b73f-d4e47fccbd61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f0752-7cc3-4ae1-a5b7-f6110ed3df98]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:54 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:54 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da7ef400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7fb4a-9557-4955-8b5a-7e8754078e9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fbf2b0-5e15-464a-8038-14ec64201a40]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2640cca-ad61-4ed8-b23c-a2cf84dbd4b2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61ef95-2c27-4076-aec8-4e71c0117bc3]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:48:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05285416-7839-4ef7-a1a6-74fddf26ba73]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26773cc-bc5c-48de-b3a0-a411b5980d25]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260]
Apr 13 17:48:55 user nova-compute[71354]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:193d8f02-ca54-46d6-896c-694afc0eef51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14546427-3155-400c-89ef-353fa623a8d7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== disconnect_volume: return (383ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBbqQyRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeoTILCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'c0363571-bba1-467c-9eb5-2ccf2fcce817': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed491aa-b4f8-4889-aedf-a8a19a75747b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: iSNS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: STATIC:
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:55 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d273359-abce-4d9b-b41d-46e12302cf38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f914da-7e1e-46f5-bd4c-35b42923ba24]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da787b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05836646-0f4a-4a63-9419-3731ccb163e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bdedb8-c10c-49a1-beeb-c72963b34be7]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d9bac7-04cb-46a2-9680-f8b0e58fb32d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30ba77-f27b-404c-a51a-ec6948ba7b58]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc9d37-8ec6-44f0-b73b-07939b2d30c8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7530e5-acd8-451f-8aea-93a72a32a157]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260]
Apr 13 17:48:55 user nova-compute[71354]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8bbde54-82c8-4365-80db-fc400c9cf78e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f12c4e-1fac-4e6c-ad2f-95d25fa1e102]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== disconnect_volume: return (325ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.321s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwlsntAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4bd0c6-febb-4747-8ddd-7a13499e2a0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: iSNS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: STATIC:
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:55 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c615ec-0b71-462d-bdb2-0f62de429a95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7608b-1dca-425a-b232-153e623dcafb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da784310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817'): ({'sdh'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Removing single pathed devices sdh {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[48664e8f-ecb4-49a8-81e2-1e17da287bff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa188d7d-0c68-411a-b85e-1bf35c820d50]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Flushing IO for device /dev/sdh {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72231547-6360-432c-b019-bd203f38dc18]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-deleted-90e3c9b9-b913-43e7-b7af-72f5ab808b6e {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: INFO nova.compute.manager [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Neutron deleted interface 90e3c9b9-b913-43e7-b7af-72f5ab808b6e; detaching it from the instance and deleting it from the info cache
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.network.neutron [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "054f8815-c1d1-4b57-9018-a34c8e785b80", "address": "fa:16:3e:e2:c7:67", "network": {"id": "1db53756-cfdb-4e80-a667-e8c0d854e760", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1934907475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054f8815-c1", "ovs_interfaceid": "054f8815-c1d1-4b57-9018-a34c8e785b80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ed2a6-bbd0-4f57-b197-a20c638e877b]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] SCSI volumes sdh have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5eaf05-7dd9-4458-baf0-6a8a37553f5f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-3b115d24-bf38-4693-83c2-21a4d44543b0 req-eda6b5e8-0410-4705-821e-4a1e65c10b51 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Detach interface failed, port_id=90e3c9b9-b913-43e7-b7af-72f5ab808b6e, reason: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-7c1cce3f-97ef-437a-8d7a-728cdf0a0b11 for instance with vm_state active and task_state deleting.
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-8a952bca-a9c0-4f7b-a8d5-8639983809cf for instance with vm_state active and task_state deleting.
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-c69b7013-5290-4bec-91d4-d1c86c94e982 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-c69b7013-5290-4bec-91d4-d1c86c94e982 for instance with vm_state active and task_state deleting.
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-c83214b4-dd3d-46bd-a2fa-793909230030 req-a3004399-74de-4616-b946-29ff24642277 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6a6a5-1069-48e4-bf85-c7713e3f60a2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260]
Apr 13 17:48:55 user nova-compute[71354]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0363571-bba1-467c-9eb5-2ccf2fcce817 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc6215-f012-4fbd-88e8-2898f114ceb2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] <== disconnect_volume: return (699ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.379s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2f364-5956-4594-81b3-48fa02802f31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: iSNS:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]: STATIC:
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:55 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:55 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:55 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:55 user nova-compute[71354]: No targets found.
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:55 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:55 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb49082-1fa5-4b0c-b461-df025b5d0528]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'fd2c1fea-4a6b-4ccb-956a-d67282ecbb11', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'serial'} {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: removing Cinder connection for volume c0363571-bba1-467c-9eb5-2ccf2fcce817 {{(pid=71354) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bcd5c3-93e1-4d0a-ad3e-1c554fec1526]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:55 user nova-compute[71354]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 (non-flash)
Apr 13 17:48:55 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d4409c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6ccf6-d44d-412e-8cd3-8036a5aab76c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 for instance with vm_state active and task_state deleting.
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-unplugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-unplugged-09e76676-6015-4205-bd23-b86f896fb6d1 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:55 user nova-compute[71354]: WARNING nova.compute.manager [req-4d70992b-1e59-4c7d-85b9-95cc947c8e50 req-cb584a1d-f301-4f67-8cf7-76a4d35691ef service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-09e76676-6015-4205-bd23-b86f896fb6d1 for instance with vm_state active and task_state deleting.
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef0dfa-1f90-4bf6-91f9-6b4f1a9ebb26]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07c868-a927-450f-a741-5270fef58e99]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd48b81-2624-48c9-9af0-f2371d5482dc]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19558b4a-e623-4718-b387-4e9d287263fb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ec2d6-cd6c-4a9f-a5de-3ae35da542bb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260]
Apr 13 17:48:56 user nova-compute[71354]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:56 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13ffd808-19cd-4644-b2e5-3a85520a4d43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb99a24-134d-4120-a84b-016723616df6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] <== disconnect_volume: return (730ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Deleting instance files /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f_del
Apr 13 17:48:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Deletion of /opt/stack/data/nova/instances/9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f_del complete
Apr 13 17:48:56 user nova-compute[71354]: INFO nova.compute.manager [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Took 4.16 seconds to destroy the instance on the hypervisor.
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] swap_volume: Updating volume c0363571-bba1-467c-9eb5-2ccf2fcce817 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "benChKug", "auth_password": "mvBoSsf307PKG1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "aac82b6d-cb0d-4153-a7e1-8fd1be4167fb"}, "status": "reserved", "instance": "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11", "attached_at": "", "detached_at": "", "volume_id": "aac82b6d-cb0d-4153-a7e1-8fd1be4167fb", "serial": "aac82b6d-cb0d-4153-a7e1-8fd1be4167fb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'no_device': None, 'attachment_id': '538ff135-a8cb-4d8a-80ce-948ec4d96dee'} {{(pid=71354) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7fb3a8-29bd-4288-9645-56a4b185c2d8 tempest-TestVolumeSwap-1376132476 tempest-TestVolumeSwap-1376132476-project-admin] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.551s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-deleted-054f8815-c1d1-4b57-9018-a34c8e785b80 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:57 user nova-compute[71354]: INFO nova.compute.manager [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Neutron deleted interface 054f8815-c1d1-4b57-9018-a34c8e785b80; detaching it from the instance and deleting it from the info cache
Apr 13 17:48:57 user nova-compute[71354]: DEBUG nova.network.neutron [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [{"id": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "address": "fa:16:3e:cf:6f:fb", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd21baf-0c", "ovs_interfaceid": "9dd21baf-0c87-4035-817b-3ecf6dad3ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "address": "fa:16:3e:fe:6f:d9", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf454a828-50", "ovs_interfaceid": "f454a828-50c6-43ba-ae8b-f2b86adbde6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2968f077-89fd-47b8-b2d8-2be699130a08", "address": "fa:16:3e:29:eb:c4", "network": {"id": "644e4ae4-6cea-480d-8625-7375da83264e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1444588562", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2968f077-89", "ovs_interfaceid": "2968f077-89fd-47b8-b2d8-2be699130a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7794066e-1eb8-4f57-b683-af981db15421", "address": "fa:16:3e:53:06:4b", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7794066e-1e", "ovs_interfaceid": "7794066e-1eb8-4f57-b683-af981db15421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "address": "fa:16:3e:7a:33:33", "network": {"id": "d6076dd0-0264-48f6-aa40-b5f348cb1d21", "bridge": "br-int", "label": "tempest-device-tagging-net2-1464377470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b192b3270576450b8c39368f07d1fae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365ecb91-8d", "ovs_interfaceid": "365ecb91-8df1-419a-b559-ab5f41e6e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-2ba03d21-8ef6-4db0-af01-a8801ce7db36 req-5ec1851a-ba5a-4c70-929b-348ff4e93b36 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Detach interface failed, port_id=054f8815-c1d1-4b57-9018-a34c8e785b80, reason: Instance ad14d742-a995-4eab-bc37-d04d3c20c170 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Acquiring lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] No waiting events found dispatching network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:48:57 user nova-compute[71354]: WARNING nova.compute.manager [req-295257c3-758e-4575-9f5d-1efc9de7082b req-6ab9ceec-8b0d-4e97-9dd6-5fe5c8b2b6f7 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received unexpected event network-vif-plugged-4f9e9206-943a-43f9-a511-18ed9e8b8c40 for instance with vm_state active and task_state deleting.
Apr 13 17:48:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:48:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:48:57 user nova-compute[71354]: INFO nova.compute.manager [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Detaching volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:58 user nova-compute[71354]: INFO nova.virt.block_device [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Attempting to driver detach volume aac82b6d-cb0d-4153-a7e1-8fd1be4167fb from mountpoint /dev/vdb
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Attempting to detach device vdb from instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:58 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:58 user nova-compute[71354]:   <source dev="/dev/sdi"/>
Apr 13 17:48:58 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:58 user nova-compute[71354]:   <serial>aac82b6d-cb0d-4153-a7e1-8fd1be4167fb</serial>
Apr 13 17:48:58 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:48:58 user nova-compute[71354]: </disk>
Apr 13 17:48:58 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Successfully detached device vdb from instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 from the persistent domain config.
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:48:58 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:48:58 user nova-compute[71354]:   <source dev="/dev/sdi"/>
Apr 13 17:48:58 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:48:58 user nova-compute[71354]:   <serial>aac82b6d-cb0d-4153-a7e1-8fd1be4167fb</serial>
Apr 13 17:48:58 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:48:58 user nova-compute[71354]: </disk>
Apr 13 17:48:58 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408138.5527327, fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:48:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Successfully detached device vdb from instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 from the live domain config.
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'benChKug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'aac82b6d-cb0d-4153-a7e1-8fd1be4167fb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:48:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[889156fd-61a5-4fb8-812d-2ce120f1d81b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:48:58 user nova-compute[71354]: No targets found.
Apr 13 17:48:58 user nova-compute[71354]: iSNS:
Apr 13 17:48:58 user nova-compute[71354]: No targets found.
Apr 13 17:48:58 user nova-compute[71354]: STATIC:
Apr 13 17:48:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb
Apr 13 17:48:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:48:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:48:58 user nova-compute[71354]: FIRMWARE:
Apr 13 17:48:58 user nova-compute[71354]: No targets found.
Apr 13 17:48:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:48:58 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:48:58 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7363d-acc5-464d-b454-4b4dd7c6ba15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8008a6-0573-4468-a8d4-5270b0add849]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb (non-flash)
Apr 13 17:48:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d421d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb'): ({'sdi'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Removing single pathed devices sdi {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c1925f-0ae7-4bf3-a2f1-8965d73d78f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d80df7-ba25-4cc5-8b22-8b3174491f0c]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Flushing IO for device /dev/sdi {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a513517-0d7b-4757-a5d3-b7b43bbb6c94]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bbf0c-de44-415e-9b14-659e0d0d08f5]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] SCSI volumes sdi have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd3a7d3-ba95-49d2-b399-7d55a31db041]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eebb9d-54f6-46b3-be40-dc76544810d6]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260]
Apr 13 17:48:58 user nova-compute[71354]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb, portal: 172.16.0.220,3260] successful.
Apr 13 17:48:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac82b6d-cb0d-4153-a7e1-8fd1be4167fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e95b7a-9c42-4d98-abeb-32ae14d31ba8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] <== disconnect_volume: return (357ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:48:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:59 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Took 6.89 seconds to deallocate network for instance.
Apr 13 17:48:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-deleted-2968f077-89fd-47b8-b2d8-2be699130a08 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-deleted-7794066e-1eb8-4f57-b683-af981db15421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Received event network-vif-deleted-365ecb91-8df1-419a-b559-ab5f41e6e38f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-deleted-4f9e9206-943a-43f9-a511-18ed9e8b8c40 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:48:59 user nova-compute[71354]: INFO nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Neutron deleted interface 4f9e9206-943a-43f9-a511-18ed9e8b8c40; detaching it from the instance and deleting it from the info cache
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.network.neutron [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [{"id": "07509622-d164-4038-ba75-5bf6cd52d615", "address": "fa:16:3e:db:e6:d9", "network": {"id": "61e4464a-644e-4c8f-b177-341dae607f50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-34479903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07509622-d1", "ovs_interfaceid": "07509622-d164-4038-ba75-5bf6cd52d615", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "address": "fa:16:3e:d4:b7:64", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1cce3f-97", "ovs_interfaceid": "7c1cce3f-97ef-437a-8d7a-728cdf0a0b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "address": "fa:16:3e:5d:30:ce", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a952bca-a9", "ovs_interfaceid": "8a952bca-a9c0-4f7b-a8d5-8639983809cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69b7013-5290-4bec-91d4-d1c86c94e982", "address": "fa:16:3e:76:d0:2d", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69b7013-52", "ovs_interfaceid": "c69b7013-5290-4bec-91d4-d1c86c94e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "address": "fa:16:3e:c2:7d:0b", "network": {"id": "2871b866-1912-4fea-a7f2-c68b85ddfc2d", "bridge": "br-int", "label": "tempest-device-tagging-net1-681086846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc44eb24-78", "ovs_interfaceid": "fc44eb24-78a4-4ead-a4fc-c35b8c943f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09e76676-6015-4205-bd23-b86f896fb6d1", "address": "fa:16:3e:70:e4:2a", "network": {"id": "47107af9-74a2-4df2-bcec-08f68c7d62ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-989962962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fff9543b4dea4fe094f886408bfa5865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e76676-60", "ovs_interfaceid": "09e76676-6015-4205-bd23-b86f896fb6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:48:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-089ddb4b-0c10-42ee-9b92-711dbaf95dff req-bc0fdbd2-c1f9-4157-9b14-4dbd07ecd5a5 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Detach interface failed, port_id=4f9e9206-943a-43f9-a511-18ed9e8b8c40, reason: Instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:49:00 user nova-compute[71354]: DEBUG nova.objects.instance [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'flavor' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-08551499-260e-4f74-bb9f-7da6e21c34ea tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.366s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:01 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Took 5.27 seconds to deallocate network for instance.
Apr 13 17:49:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-deleted-09e76676-6015-4205-bd23-b86f896fb6d1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-deleted-07509622-d164-4038-ba75-5bf6cd52d615 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-deleted-c69b7013-5290-4bec-91d4-d1c86c94e982 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-04bfd6fa-70a6-4997-9ab3-174f62887fd5 req-929a08c4-f555-438a-813a-003d77e7c5e6 service nova] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Received event network-vif-deleted-fc44eb24-78a4-4ead-a4fc-c35b8c943f63 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:02 user nova-compute[71354]: INFO nova.compute.manager [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Took 2.89 seconds to detach 3 volumes for instance.
Apr 13 17:49:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:02 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:02 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:02 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Deleted allocations for instance ad14d742-a995-4eab-bc37-d04d3c20c170
Apr 13 17:49:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9dc5dc5d-987d-49b9-845b-0ad807ac707f tempest-TaggedBootDevicesTest_v242-354774172 tempest-TaggedBootDevicesTest_v242-354774172-project-member] Lock "ad14d742-a995-4eab-bc37-d04d3c20c170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.573s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:04 user nova-compute[71354]: INFO nova.compute.manager [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Took 2.60 seconds to detach 3 volumes for instance.
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408128.7271051, ad14d742-a995-4eab-bc37-d04d3c20c170 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:04 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] VM Stopped (Lifecycle Event)
Apr 13 17:49:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-714e28dc-b7bb-4421-b9b4-7fc1350dfbb7 None None] [instance: ad14d742-a995-4eab-bc37-d04d3c20c170] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:04 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Deleted allocations for instance 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58c3a1a9-bb9f-4523-839b-bb5462be828b tempest-TaggedBootDevicesTest-1780397263 tempest-TaggedBootDevicesTest-1780397263-project-member] Lock "9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.587s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:49:05 user nova-compute[71354]: INFO nova.compute.claims [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Claim successful on node user
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:49:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.policy [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:49:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Creating image(s)
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk 1073741824" returned: 0 in 0.048s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.164s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Successfully created port: 723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Cannot resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.objects.instance [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'migration_context' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Ensure instance console log exists: /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Successfully updated port: 723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-changed-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Refreshing instance network info cache due to event network-changed-723c0bf0-b727-4ff6-b9fe-2197b7609fa0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:49:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance network_info: |[{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Refreshing network info cache for port 723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start _get_guest_xml network_info=[{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:49:07 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:07 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.objects.instance [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'pci_devices' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:49:07 user nova-compute[71354]:   <uuid>bcfd107b-fef8-4acf-9a2c-1861aabacfe9</uuid>
Apr 13 17:49:07 user nova-compute[71354]:   <name>instance-0000000d</name>
Apr 13 17:49:07 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:49:07 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:49:07 user nova-compute[71354]:   <metadata>
Apr 13 17:49:07 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:49:07 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeTestJSON-server-1433621576</nova:name>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:49:07</nova:creationTime>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:49:07 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:49:07 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:owner>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:user uuid="91769944ac8048dbb1f418d232e670d3">tempest-AttachVolumeTestJSON-2087525588-project-member</nova:user>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:project uuid="5ee8ad9e1bc74eb9b9997f7706d3f096">tempest-AttachVolumeTestJSON-2087525588</nova:project>
Apr 13 17:49:07 user nova-compute[71354]:       </nova:owner>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:49:07 user nova-compute[71354]:       <nova:ports>
Apr 13 17:49:07 user nova-compute[71354]:         <nova:port uuid="723c0bf0-b727-4ff6-b9fe-2197b7609fa0">
Apr 13 17:49:07 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:49:07 user nova-compute[71354]:         </nova:port>
Apr 13 17:49:07 user nova-compute[71354]:       </nova:ports>
Apr 13 17:49:07 user nova-compute[71354]:     </nova:instance>
Apr 13 17:49:07 user nova-compute[71354]:   </metadata>
Apr 13 17:49:07 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:49:07 user nova-compute[71354]:     <system>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="serial">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="uuid">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:49:07 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:49:07 user nova-compute[71354]:     </system>
Apr 13 17:49:07 user nova-compute[71354]:   </sysinfo>
Apr 13 17:49:07 user nova-compute[71354]:   <os>
Apr 13 17:49:07 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:49:07 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:49:07 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:49:07 user nova-compute[71354]:   </os>
Apr 13 17:49:07 user nova-compute[71354]:   <features>
Apr 13 17:49:07 user nova-compute[71354]:     <acpi/>
Apr 13 17:49:07 user nova-compute[71354]:     <apic/>
Apr 13 17:49:07 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:49:07 user nova-compute[71354]:   </features>
Apr 13 17:49:07 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:49:07 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:49:07 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:49:07 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:49:07 user nova-compute[71354]:   </clock>
Apr 13 17:49:07 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:49:07 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:49:07 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:49:07 user nova-compute[71354]:   </cpu>
Apr 13 17:49:07 user nova-compute[71354]:   <devices>
Apr 13 17:49:07 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:49:07 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:49:07 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk"/>
Apr 13 17:49:07 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:49:07 user nova-compute[71354]:     </disk>
Apr 13 17:49:07 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:49:07 user nova-compute[71354]:       <mac address="fa:16:3e:9b:e2:8a"/>
Apr 13 17:49:07 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:07 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:49:07 user nova-compute[71354]:       <target dev="tap723c0bf0-b7"/>
Apr 13 17:49:07 user nova-compute[71354]:     </interface>
Apr 13 17:49:07 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:49:07 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/console.log" append="off"/>
Apr 13 17:49:07 user nova-compute[71354]:     </serial>
Apr 13 17:49:07 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:49:07 user nova-compute[71354]:     <video>
Apr 13 17:49:07 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:07 user nova-compute[71354]:     </video>
Apr 13 17:49:07 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:49:07 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:49:07 user nova-compute[71354]:     </rng>
Apr 13 17:49:07 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:49:07 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:49:07 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:49:07 user nova-compute[71354]:     </memballoon>
Apr 13 17:49:07 user nova-compute[71354]:   </devices>
Apr 13 17:49:07 user nova-compute[71354]: </domain>
Apr 13 17:49:07 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG os_vif [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap723c0bf0-b7, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap723c0bf0-b7, col_values=(('external_ids', {'iface-id': '723c0bf0-b727-4ff6-b9fe-2197b7609fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:e2:8a', 'vm-uuid': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:07 user nova-compute[71354]: INFO os_vif [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No VIF found with MAC fa:16:3e:9b:e2:8a, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updated VIF entry in instance network info cache for port 723c0bf0-b727-4ff6-b9fe-2197b7609fa0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-57317ff7-eae9-4c7b-a781-1d6905789934 req-33c91aee-617c-4f92-98b7-93c021e4c293 service nova] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:08 user nova-compute[71354]: WARNING nova.compute.manager [req-c4a13318-6347-49fc-844e-b31414630196 req-872bea66-acd3-42c3-bece-bc8f078fc8e2 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state building and task_state spawning.
Apr 13 17:49:09 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408134.0594814, 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:09 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] VM Stopped (Lifecycle Event)
Apr 13 17:49:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-459592b3-c09c-4e2f-bd52-6ac7d37fa382 None None] [instance: 9eb1224d-f7ae-4b3d-9da3-fe18d4057e2f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408150.8446138, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Resumed (Lifecycle Event)
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance spawned successfully.
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408150.8461132, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Started (Lifecycle Event)
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 13 17:49:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:10 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:11 user nova-compute[71354]: INFO nova.compute.manager [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Took 6.04 seconds to build instance.
Apr 13 17:49:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:11 user nova-compute[71354]: WARNING nova.compute.manager [req-24ddd173-fa42-47aa-9e06-4ee197b9c174 req-4b88fe7e-e031-4b98-ac3a-f6d9360b605e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state active and task_state None.
Apr 13 17:49:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d321684d-0153-4d98-a6db-ba983c0576f3 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.153s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:49:19 user nova-compute[71354]: INFO nova.compute.claims [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Claim successful on node user
Apr 13 17:49:19 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:49:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.policy [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d77fa5340ce44099224f2f161af5ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6ea575d2574fcc99712adece6db415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:49:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Creating image(s)
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "/opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "/opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.179s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk 1073741824" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Successfully created port: 919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Cannot resize image /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'migration_context' on Instance uuid bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Ensure instance console log exists: /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Successfully updated port: 919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquired lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-changed-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Refreshing instance network info cache due to event network-changed-919ef722-99b4-433d-9c37-e6ef30672421. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Acquiring lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Updating instance_info_cache with network_info: [{"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Releasing lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Instance network_info: |[{"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Acquired lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Refreshing network info cache for port 919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Start _get_guest_xml network_info=[{"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:49:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509906458',display_name='tempest-VolumesAdminNegativeTest-server-509906458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509906458',id=14,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-9218ii82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:20Z,user_data=None,user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'pci_devices' on Instance uuid bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:49:22 user nova-compute[71354]:   <uuid>bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84</uuid>
Apr 13 17:49:22 user nova-compute[71354]:   <name>instance-0000000e</name>
Apr 13 17:49:22 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:49:22 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:49:22 user nova-compute[71354]:   <metadata>
Apr 13 17:49:22 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:49:22 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:name>tempest-VolumesAdminNegativeTest-server-509906458</nova:name>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:49:22</nova:creationTime>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:49:22 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:49:22 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:owner>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:user uuid="5d77fa5340ce44099224f2f161af5ecc">tempest-VolumesAdminNegativeTest-1540143869-project-member</nova:user>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:project uuid="2d6ea575d2574fcc99712adece6db415">tempest-VolumesAdminNegativeTest-1540143869</nova:project>
Apr 13 17:49:22 user nova-compute[71354]:       </nova:owner>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:49:22 user nova-compute[71354]:       <nova:ports>
Apr 13 17:49:22 user nova-compute[71354]:         <nova:port uuid="919ef722-99b4-433d-9c37-e6ef30672421">
Apr 13 17:49:22 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:49:22 user nova-compute[71354]:         </nova:port>
Apr 13 17:49:22 user nova-compute[71354]:       </nova:ports>
Apr 13 17:49:22 user nova-compute[71354]:     </nova:instance>
Apr 13 17:49:22 user nova-compute[71354]:   </metadata>
Apr 13 17:49:22 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:49:22 user nova-compute[71354]:     <system>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="serial">bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84</entry>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="uuid">bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84</entry>
Apr 13 17:49:22 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:49:22 user nova-compute[71354]:     </system>
Apr 13 17:49:22 user nova-compute[71354]:   </sysinfo>
Apr 13 17:49:22 user nova-compute[71354]:   <os>
Apr 13 17:49:22 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:49:22 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:49:22 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:49:22 user nova-compute[71354]:   </os>
Apr 13 17:49:22 user nova-compute[71354]:   <features>
Apr 13 17:49:22 user nova-compute[71354]:     <acpi/>
Apr 13 17:49:22 user nova-compute[71354]:     <apic/>
Apr 13 17:49:22 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:49:22 user nova-compute[71354]:   </features>
Apr 13 17:49:22 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:49:22 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:49:22 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:49:22 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:49:22 user nova-compute[71354]:   </clock>
Apr 13 17:49:22 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:49:22 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:49:22 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:49:22 user nova-compute[71354]:   </cpu>
Apr 13 17:49:22 user nova-compute[71354]:   <devices>
Apr 13 17:49:22 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:49:22 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:49:22 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk"/>
Apr 13 17:49:22 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:49:22 user nova-compute[71354]:     </disk>
Apr 13 17:49:22 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:49:22 user nova-compute[71354]:       <mac address="fa:16:3e:0b:a7:07"/>
Apr 13 17:49:22 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:22 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:49:22 user nova-compute[71354]:       <target dev="tap919ef722-99"/>
Apr 13 17:49:22 user nova-compute[71354]:     </interface>
Apr 13 17:49:22 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:49:22 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/console.log" append="off"/>
Apr 13 17:49:22 user nova-compute[71354]:     </serial>
Apr 13 17:49:22 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:49:22 user nova-compute[71354]:     <video>
Apr 13 17:49:22 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:22 user nova-compute[71354]:     </video>
Apr 13 17:49:22 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:49:22 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:49:22 user nova-compute[71354]:     </rng>
Apr 13 17:49:22 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:49:22 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:49:22 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:49:22 user nova-compute[71354]:     </memballoon>
Apr 13 17:49:22 user nova-compute[71354]:   </devices>
Apr 13 17:49:22 user nova-compute[71354]: </domain>
Apr 13 17:49:22 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509906458',display_name='tempest-VolumesAdminNegativeTest-server-509906458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509906458',id=14,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-9218ii82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:20Z,user_data=None,user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG os_vif [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap919ef722-99, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap919ef722-99, col_values=(('external_ids', {'iface-id': '919ef722-99b4-433d-9c37-e6ef30672421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:a7:07', 'vm-uuid': 'bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:22 user nova-compute[71354]: INFO os_vif [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99')
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] No VIF found with MAC fa:16:3e:0b:a7:07, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Updated VIF entry in instance network info cache for port 919ef722-99b4-433d-9c37-e6ef30672421. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Updating instance_info_cache with network_info: [{"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb55b2ad-7321-48fb-b25c-5e4232ce7fa9 req-a0ffa1a1-6413-4935-8b77-27f763ab2fdb service nova] Releasing lock "refresh_cache-bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] No waiting events found dispatching network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:24 user nova-compute[71354]: WARNING nova.compute.manager [req-604657bd-2a02-4126-887d-97a63b0a9476 req-44b09857-b794-4f36-92b6-5751870e954e service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received unexpected event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 for instance with vm_state building and task_state spawning.
Apr 13 17:49:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:25 user nova-compute[71354]: INFO nova.compute.manager [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Attaching volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 to /dev/vdb
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.utils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[62384107-a3eb-4471-94f2-5a7707dda48e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f9496-4354-4378-b58e-542d56b0b8be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe42c43-e419-43cf-a0fa-ffe42e80155b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ca6d3-5826-479d-84b5-0e8a9c5ba000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:25 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:49:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba9a2d-37fb-4a36-afb3-208b2f81f845]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG os_brick.utils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:25 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating existing volume attachment record: c0ab2bc6-3d39-4820-852c-3be51cccfd77 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408166.3437288, bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] VM Resumed (Lifecycle Event)
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Instance spawned successfully.
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408166.3439379, bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] VM Started (Lifecycle Event)
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] No waiting events found dispatching network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:26 user nova-compute[71354]: WARNING nova.compute.manager [req-122846f7-c91b-490e-ab38-5cea3c66d124 req-ccbd73b9-159a-46a5-a0d4-d3ebb50f5d05 service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received unexpected event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 for instance with vm_state building and task_state spawning.
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 13 17:49:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Took 7.08 seconds to build instance.
Apr 13 17:49:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f67608ed-c08d-49f8-833c-877735fe6ede tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:30 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d67def-a0fe-48ae-b0e1-3e26692a014c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:49:30 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebbaf9-6cef-4a73-bc7d-488e434ea2f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44] added
Apr 13 17:49:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9f590-1b5c-49e4-bc64-8dc2d2aa9948]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a2f51-9f43-4881-b661-b1cd2a0143d6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idMJSAnQ {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idMJSAnQ" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[880eb98c-f2c1-4336-a71a-7e541a885c1e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idMJSAnQ'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e164ee-6f5d-46bd-83c1-5a80c8a14e6f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.099s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ddafe-dacf-4f1c-82b8-fab688a1e46c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:49:30 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:49:30 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:49:30 user nova-compute[71354]: 
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d29ec-4076-4884-badc-cf16ad8be5a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]
Apr 13 17:49:30 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.
Apr 13 17:49:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe82f6c-358c-4a44-b71c-9faba289e268]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3e38de-13e7-4210-9bf3-4d015c73f412]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b18cf3f-dbbd-49e2-84b9-7090fa7dfe47]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:49:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23264613036653264', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264613036653264', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:49:31 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:49:31 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 17:49:31 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:49:31 user nova-compute[71354]:   <serial>db7bdb03-7472-4dd3-85ee-680fb0fe5d44</serial>
Apr 13 17:49:31 user nova-compute[71354]: </disk>
Apr 13 17:49:31 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:49:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No VIF found with MAC fa:16:3e:d3:be:f6, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:49:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8bb752f6-163f-4d31-8db4-3e953270becc tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.965s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing instance network info cache due to event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG nova.network.neutron [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:37 user nova-compute[71354]: INFO nova.compute.manager [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Terminating instance
Apr 13 17:49:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Instance destroyed successfully.
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'resources' on Instance uuid 0243764f-846b-4675-9ea1-49d07b05cdb5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-199077965',display_name='tempest-ServersNegativeTestJSON-server-199077965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-199077965',id=12,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-yijoojco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:47:55Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=0243764f-846b-4675-9ea1-49d07b05cdb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "address": "fa:16:3e:68:8a:28", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb49c554-4e", "ovs_interfaceid": "cb49c554-4ee4-463a-9556-318e3aae8a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG os_vif [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb49c554-4e, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:38 user nova-compute[71354]: INFO os_vif [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8a:28,bridge_name='br-int',has_traffic_filtering=True,id=cb49c554-4ee4-463a-9556-318e3aae8a0f,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb49c554-4e')
Apr 13 17:49:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Deleting instance files /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5_del
Apr 13 17:49:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Deletion of /opt/stack/data/nova/instances/0243764f-846b-4675-9ea1-49d07b05cdb5_del complete
Apr 13 17:49:38 user nova-compute[71354]: INFO nova.compute.manager [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 13 17:49:38 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:49:38 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.network.neutron [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updated VIF entry in instance network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.network.neutron [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-03e6dcde-e89c-49ce-9ad9-30294f282540 req-305786aa-e9ea-4241-a9ea-d6784c06cb66 service nova] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-unplugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] No waiting events found dispatching network-vif-unplugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-unplugged-cb49c554-4ee4-463a-9556-318e3aae8a0f for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Acquiring lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] No waiting events found dispatching network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:39 user nova-compute[71354]: WARNING nova.compute.manager [req-f495f4a9-dd1d-4a70-a7ec-a673f9c1b07c req-1dedb323-435d-4f2e-a1cf-f33560897f2d service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received unexpected event network-vif-plugged-cb49c554-4ee4-463a-9556-318e3aae8a0f for instance with vm_state active and task_state deleting.
Apr 13 17:49:40 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:40 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Took 1.14 seconds to deallocate network for instance.
Apr 13 17:49:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-37e674a8-7673-4b7d-9b4b-ee8d4a727351 req-63247da1-9333-4ba4-a274-3f5015ffa5de service nova] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Received event network-vif-deleted-cb49c554-4ee4-463a-9556-318e3aae8a0f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:40 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Deleted allocations for instance 0243764f-846b-4675-9ea1-49d07b05cdb5
Apr 13 17:49:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b59f301-4d2a-4d4e-a8b7-1501d77f4086 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "0243764f-846b-4675-9ea1-49d07b05cdb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.702s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:49:41 user nova-compute[71354]: INFO nova.compute.claims [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Claim successful on node user
Apr 13 17:49:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing instance network info cache due to event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:49:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:49:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Creating image(s)
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "/opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG nova.policy [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.162s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk 1073741824" returned: 0 in 0.103s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Cannot resize image /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'migration_context' on Instance uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updated VIF entry in instance network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.network.neutron [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Ensure instance console log exists: /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fb3a83e8-2963-4e5f-8c74-7895582562ee req-fc2157d1-fa86-48f7-856b-7ed5a6cf5b96 service nova] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Successfully created port: ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:49:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Successfully updated port: ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-changed-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Refreshing instance network info cache due to event network-changed-ba1b3297-9105-4622-87e9-fdfa2daa7106. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Acquiring lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:44 user nova-compute[71354]: INFO nova.compute.manager [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Rebooting instance
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.neutron [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Instance network_info: |[{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Acquired lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.neutron [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Refreshing network info cache for port ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Start _get_guest_xml network_info=[{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:49:45 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:45 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1259821018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1259821018',id=15,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-vu966ylp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:42Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=db0dac50-5f78-406c-bd56-3d7cdf43d1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.objects.instance [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:49:45 user nova-compute[71354]:   <uuid>db0dac50-5f78-406c-bd56-3d7cdf43d1cb</uuid>
Apr 13 17:49:45 user nova-compute[71354]:   <name>instance-0000000f</name>
Apr 13 17:49:45 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:49:45 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:49:45 user nova-compute[71354]:   <metadata>
Apr 13 17:49:45 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:49:45 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1259821018</nova:name>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:49:45</nova:creationTime>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:49:45 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:49:45 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:owner>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 17:49:45 user nova-compute[71354]:       </nova:owner>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:49:45 user nova-compute[71354]:       <nova:ports>
Apr 13 17:49:45 user nova-compute[71354]:         <nova:port uuid="ba1b3297-9105-4622-87e9-fdfa2daa7106">
Apr 13 17:49:45 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 17:49:45 user nova-compute[71354]:         </nova:port>
Apr 13 17:49:45 user nova-compute[71354]:       </nova:ports>
Apr 13 17:49:45 user nova-compute[71354]:     </nova:instance>
Apr 13 17:49:45 user nova-compute[71354]:   </metadata>
Apr 13 17:49:45 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:49:45 user nova-compute[71354]:     <system>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="serial">db0dac50-5f78-406c-bd56-3d7cdf43d1cb</entry>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="uuid">db0dac50-5f78-406c-bd56-3d7cdf43d1cb</entry>
Apr 13 17:49:45 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:49:45 user nova-compute[71354]:     </system>
Apr 13 17:49:45 user nova-compute[71354]:   </sysinfo>
Apr 13 17:49:45 user nova-compute[71354]:   <os>
Apr 13 17:49:45 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:49:45 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:49:45 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:49:45 user nova-compute[71354]:   </os>
Apr 13 17:49:45 user nova-compute[71354]:   <features>
Apr 13 17:49:45 user nova-compute[71354]:     <acpi/>
Apr 13 17:49:45 user nova-compute[71354]:     <apic/>
Apr 13 17:49:45 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:49:45 user nova-compute[71354]:   </features>
Apr 13 17:49:45 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:49:45 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:49:45 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:49:45 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:49:45 user nova-compute[71354]:   </clock>
Apr 13 17:49:45 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:49:45 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:49:45 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:49:45 user nova-compute[71354]:   </cpu>
Apr 13 17:49:45 user nova-compute[71354]:   <devices>
Apr 13 17:49:45 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:49:45 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:49:45 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk"/>
Apr 13 17:49:45 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:49:45 user nova-compute[71354]:     </disk>
Apr 13 17:49:45 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:49:45 user nova-compute[71354]:       <mac address="fa:16:3e:8d:0d:3d"/>
Apr 13 17:49:45 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:45 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:49:45 user nova-compute[71354]:       <target dev="tapba1b3297-91"/>
Apr 13 17:49:45 user nova-compute[71354]:     </interface>
Apr 13 17:49:45 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:49:45 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/console.log" append="off"/>
Apr 13 17:49:45 user nova-compute[71354]:     </serial>
Apr 13 17:49:45 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:49:45 user nova-compute[71354]:     <video>
Apr 13 17:49:45 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:45 user nova-compute[71354]:     </video>
Apr 13 17:49:45 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:49:45 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:49:45 user nova-compute[71354]:     </rng>
Apr 13 17:49:45 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:49:45 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:49:45 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:49:45 user nova-compute[71354]:     </memballoon>
Apr 13 17:49:45 user nova-compute[71354]:   </devices>
Apr 13 17:49:45 user nova-compute[71354]: </domain>
Apr 13 17:49:45 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1259821018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1259821018',id=15,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-vu966ylp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:42Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=db0dac50-5f78-406c-bd56-3d7cdf43d1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG os_vif [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba1b3297-91, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba1b3297-91, col_values=(('external_ids', {'iface-id': 'ba1b3297-9105-4622-87e9-fdfa2daa7106', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:0d:3d', 'vm-uuid': 'db0dac50-5f78-406c-bd56-3d7cdf43d1cb'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:45 user nova-compute[71354]: INFO os_vif [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91')
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:8d:0d:3d, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.objects.instance [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'flavor' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:46 user nova-compute[71354]: INFO nova.compute.manager [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attaching volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9 to /dev/vdb
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.network.neutron [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updated VIF entry in instance network info cache for port ba1b3297-9105-4622-87e9-fdfa2daa7106. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.network.neutron [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-31dd3923-123a-4fad-bdd3-17e6a8b67454 req-fcde7d3d-43bb-4542-94af-019f1b58ab56 service nova] Releasing lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.utils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b47f56-7b71-45d6-a06b-950eb00e7977]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c1929c-fffb-4e2a-8854-ab6d4ec93793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d49a0-4403-4ace-a8cf-b5c89840b7ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d48f0-6a76-48bd-9830-430e022d2c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:46 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ed9a4-74f8-4d9f-bffb-df9e4481a7c2]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG os_brick.utils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating existing volume attachment record: 70079263-e62d-489b-a6b0-1ce6a291ffc5 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:47 user nova-compute[71354]: WARNING nova.compute.manager [req-aa0a0031-ff43-43cb-9830-0795f695546a req-0cd37667-f51c-469d-972c-86c5862783ba service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance destroyed successfully.
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'resources' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:49:46Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c1fde03-37, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:47 user nova-compute[71354]: INFO os_vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37')
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:47 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b7b2d-b676-4504-8e99-9f6711b37767]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:49:47 user nova-compute[71354]: No targets found.
Apr 13 17:49:47 user nova-compute[71354]: iSNS:
Apr 13 17:49:47 user nova-compute[71354]: No targets found.
Apr 13 17:49:47 user nova-compute[71354]: STATIC:
Apr 13 17:49:47 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44
Apr 13 17:49:47 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:49:47 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:49:47 user nova-compute[71354]: FIRMWARE:
Apr 13 17:49:47 user nova-compute[71354]: No targets found.
Apr 13 17:49:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:49:47 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:49:47 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75eee1d-a841-493b-90e5-6e5a662ba573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beaa54a-b85c-4e4b-a6b5-e279893e0f2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d40d1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daeba78-864c-4577-9eba-86a03d01a61d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b29e8b-96b9-418f-924c-1487d19e1c7a]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:49:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091927a-d55f-42d7-a01d-432f5df084cb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=26.474369049072266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:48 user nova-compute[71354]: INFO nova.compute.manager [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Terminating instance
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4322d618-6def-4267-9a7a-b2b436b5c192]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8248ce14-93c5-48d8-8d5b-1ccb36ec07dd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[441badd1-2d08-421c-9851-b3ceb8e2a21f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]
Apr 13 17:49:48 user nova-compute[71354]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.
Apr 13 17:49:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80beef3-9b23-4a56-a7e0-28cac14b53ad]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.997s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== disconnect_volume: return (1000ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start _get_guest_xml network_info=[{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f74a8be6-03b3-48d9-81ef-7d62c11ef0e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'f74a8be6-03b3-48d9-81ef-7d62c11ef0e3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'c0ab2bc6-3d39-4820-852c-3be51cccfd77', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '832e4b85-2c48-469d-a21e-c56cccfcabe4', 'attached_at': '', 'detached_at': '', 'volume_id': 'db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'serial': 'db7bdb03-7472-4dd3-85ee-680fb0fe5d44'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f74a8be6-03b3-48d9-81ef-7d62c11ef0e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:48 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:48 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:48 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b62d2f-ca92-4e7a-8c95-f5cf1724e108]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:49:48 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164cf7e-25c4-47df-a332-0b6d7677957e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44] added
Apr 13 17:49:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d9539-4686-4fa6-a8e5-0e3dd58c4857]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[00753662-f954-4567-a3e4-6054f2ed481d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idMJSAnQ {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idMJSAnQ" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a47c0d6-910c-4803-a959-5d9715ff21dd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idMJSAnQ'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fafc91a-18b6-420a-bd82-495ac928602b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c991c-d165-4e83-8f34-b93503518255]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:49:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:49:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:49:49 user nova-compute[71354]: 
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c450da-11fc-4c33-9db7-ad9dc751423f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]
Apr 13 17:49:49 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.
Apr 13 17:49:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8c446-3659-4b4f-9053-f39ed18405a1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abbf433-a765-49fe-a499-60cf1f436c29]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:49 user nova-compute[71354]: WARNING nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] No waiting events found dispatching network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:49 user nova-compute[71354]: WARNING nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received unexpected event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance with vm_state building and task_state spawning.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] No waiting events found dispatching network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:49 user nova-compute[71354]: WARNING nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received unexpected event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance with vm_state building and task_state spawning.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-unplugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] No waiting events found dispatching network-vif-unplugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-unplugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Acquiring lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] No waiting events found dispatching network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:49 user nova-compute[71354]: WARNING nova.compute.manager [req-8e363a10-cd78-49e4-9244-42828bc3696f req-0915989e-e40e-4ac6-add5-e9de80016e20 service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received unexpected event network-vif-plugged-0111f3ea-a151-4ee0-8497-c181f4c2d9dd for instance with vm_state active and task_state deleting.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e8d268-75a7-4888-b68d-4e439fd9f204]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Instance destroyed successfully.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lazy-loading 'resources' on Instance uuid fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1753786794',display_name='tempest-TestVolumeSwap-server-1753786794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1753786794',id=8,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHliqmBvXni1z1lSQ9+BPDZpXY+5Ahm8yw2vvM1dM/dD3VVaH+n290mcGYbV0smQzfAewnTjJfL5irp7biydbsFyUv3y2r7mdKjKMJg2VeEnlJlYqpcHulTXS5EGf6D/w==',key_name='tempest-keypair-573436766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2125d26c69b434380ee15d03c9a196b',ramdisk_id='',reservation_id='r-hrbj5saj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-197886889',owner_user_name='tempest-TestVolumeSwap-197886889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3023cacc072d43119d59765f0e0c5da7',uuid=fd2c1fea-4a6b-4ccb-956a-d67282ecbb11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converting VIF {"id": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "address": "fa:16:3e:5c:b5:5e", "network": {"id": "4ac3b800-54d0-436a-ac12-39bbfaee61e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-652918923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2125d26c69b434380ee15d03c9a196b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0111f3ea-a1", "ovs_interfaceid": "0111f3ea-a151-4ee0-8497-c181f4c2d9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG os_vif [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0111f3ea-a1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:49 user nova-compute[71354]: INFO os_vif [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b5:5e,bridge_name='br-int',has_traffic_filtering=True,id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd,network=Network(4ac3b800-54d0-436a-ac12-39bbfaee61e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0111f3ea-a1')
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Deleting instance files /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11_del
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Deletion of /opt/stack/data/nova/instances/fd2c1fea-4a6b-4ccb-956a-d67282ecbb11_del complete
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408189.7584717, db0dac50-5f78-406c-bd56-3d7cdf43d1cb => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] VM Resumed (Lifecycle Event)
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Instance spawned successfully.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408189.7627385, db0dac50-5f78-406c-bd56-3d7cdf43d1cb => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] VM Started (Lifecycle Event)
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Took 7.42 seconds to spawn the instance on the hypervisor.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:49 user nova-compute[71354]: INFO nova.compute.manager [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Took 8.20 seconds to build instance.
Apr 13 17:49:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dba0383a-71c9-424d-91de-626ec0d63492 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.290s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23264613036653264', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264613036653264', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:49:46Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'pci_devices' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:49:50 user nova-compute[71354]:   <uuid>832e4b85-2c48-469d-a21e-c56cccfcabe4</uuid>
Apr 13 17:49:50 user nova-compute[71354]:   <name>instance-0000000b</name>
Apr 13 17:49:50 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:49:50 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:49:50 user nova-compute[71354]:   <metadata>
Apr 13 17:49:50 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:49:50 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:name>tempest-TestMinimumBasicScenario-server-652760998</nova:name>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:49:48</nova:creationTime>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:49:50 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:49:50 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:owner>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:user uuid="8bdac67b9cc149b4b802c96fc87fc801">tempest-TestMinimumBasicScenario-1587858147-project-member</nova:user>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:project uuid="88bc3754064947c89397db4a80161b3a">tempest-TestMinimumBasicScenario-1587858147</nova:project>
Apr 13 17:49:50 user nova-compute[71354]:       </nova:owner>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:root type="image" uuid="f74a8be6-03b3-48d9-81ef-7d62c11ef0e3"/>
Apr 13 17:49:50 user nova-compute[71354]:       <nova:ports>
Apr 13 17:49:50 user nova-compute[71354]:         <nova:port uuid="7c1fde03-37b1-418b-8a56-9d046c05a1e0">
Apr 13 17:49:50 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:49:50 user nova-compute[71354]:         </nova:port>
Apr 13 17:49:50 user nova-compute[71354]:       </nova:ports>
Apr 13 17:49:50 user nova-compute[71354]:     </nova:instance>
Apr 13 17:49:50 user nova-compute[71354]:   </metadata>
Apr 13 17:49:50 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:49:50 user nova-compute[71354]:     <system>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="serial">832e4b85-2c48-469d-a21e-c56cccfcabe4</entry>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="uuid">832e4b85-2c48-469d-a21e-c56cccfcabe4</entry>
Apr 13 17:49:50 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:49:50 user nova-compute[71354]:     </system>
Apr 13 17:49:50 user nova-compute[71354]:   </sysinfo>
Apr 13 17:49:50 user nova-compute[71354]:   <os>
Apr 13 17:49:50 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:49:50 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:49:50 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:49:50 user nova-compute[71354]:   </os>
Apr 13 17:49:50 user nova-compute[71354]:   <features>
Apr 13 17:49:50 user nova-compute[71354]:     <acpi/>
Apr 13 17:49:50 user nova-compute[71354]:     <apic/>
Apr 13 17:49:50 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:49:50 user nova-compute[71354]:   </features>
Apr 13 17:49:50 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:49:50 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:49:50 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:49:50 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:49:50 user nova-compute[71354]:   </clock>
Apr 13 17:49:50 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:49:50 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:49:50 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:49:50 user nova-compute[71354]:   </cpu>
Apr 13 17:49:50 user nova-compute[71354]:   <devices>
Apr 13 17:49:50 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:49:50 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:49:50 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk"/>
Apr 13 17:49:50 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:49:50 user nova-compute[71354]:     </disk>
Apr 13 17:49:50 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:49:50 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:49:50 user nova-compute[71354]:       <source dev="/dev/sdb"/>
Apr 13 17:49:50 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:49:50 user nova-compute[71354]:       <serial>db7bdb03-7472-4dd3-85ee-680fb0fe5d44</serial>
Apr 13 17:49:50 user nova-compute[71354]:     </disk>
Apr 13 17:49:50 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:49:50 user nova-compute[71354]:       <mac address="fa:16:3e:d3:be:f6"/>
Apr 13 17:49:50 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:50 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:49:50 user nova-compute[71354]:       <target dev="tap7c1fde03-37"/>
Apr 13 17:49:50 user nova-compute[71354]:     </interface>
Apr 13 17:49:50 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:49:50 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/console.log" append="off"/>
Apr 13 17:49:50 user nova-compute[71354]:     </serial>
Apr 13 17:49:50 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:49:50 user nova-compute[71354]:     <video>
Apr 13 17:49:50 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:49:50 user nova-compute[71354]:     </video>
Apr 13 17:49:50 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:49:50 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:49:50 user nova-compute[71354]:     </rng>
Apr 13 17:49:50 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:49:50 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:49:50 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:49:50 user nova-compute[71354]:     </memballoon>
Apr 13 17:49:50 user nova-compute[71354]:   </devices>
Apr 13 17:49:50 user nova-compute[71354]: </domain>
Apr 13 17:49:50 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 69605608-790d-49be-ab18-277549242bef] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Received event network-vif-deleted-0111f3ea-a151-4ee0-8497-c181f4c2d9dd {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:50 user nova-compute[71354]: INFO nova.compute.manager [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Neutron deleted interface 0111f3ea-a151-4ee0-8497-c181f4c2d9dd; detaching it from the instance and deleting it from the info cache
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.network.neutron [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:50 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Took 0.95 seconds to deallocate network for instance.
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-590ae8f9-e785-4e8f-b387-d03512a9b674 req-2c406559-c16f-4d15-8fac-3f3a3dbd516a service nova] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Detach interface failed, port_id=0111f3ea-a151-4ee0-8497-c181f4c2d9dd, reason: Instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'trusted_certs' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:49:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Cannot resize image /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'migration_context' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:46Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c1fde03-37, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c1fde03-37, col_values=(('external_ids', {'iface-id': '7c1fde03-37b1-418b-8a56-9d046c05a1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:be:f6', 'vm-uuid': '832e4b85-2c48-469d-a21e-c56cccfcabe4'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:51 user nova-compute[71354]: INFO os_vif [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37')
Apr 13 17:49:51 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Deleted allocations for instance fd2c1fea-4a6b-4ccb-956a-d67282ecbb11
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 69605608-790d-49be-ab18-277549242bef] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-dcae79d5-354b-4662-8c18-ae9581add257 tempest-TestVolumeSwap-197886889 tempest-TestVolumeSwap-197886889-project-member] Lock "fd2c1fea-4a6b-4ccb-956a-d67282ecbb11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:51 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de005073-185b-4307-a698-1c23145dee76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:49:51 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b5bee-2bf7-48ca-9116-788507c1310b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9] added
Apr 13 17:49:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06d5fa-bb7f-4e3d-88e6-fa49a3ed7057]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc4b8df-5c97-47dc-8fab-16b4b0618474]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMJtDRkL {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMJtDRkL" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cdfdc2-bd53-4362-b4ab-422d5db60edb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMJtDRkL'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88556bff-a8f2-4c04-b480-fafacec46a6a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec4d4da-f533-489c-b97a-2fd15f119d24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d245e544-f4ff-4c01-9e81-9ca70f28f5b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]
Apr 13 17:49:52 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.
Apr 13 17:49:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2eba38-1a76-434d-919f-801f71246392]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31776f-3c64-437a-804c-803e40f9a39f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:52 user nova-compute[71354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:49:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:52 user nova-compute[71354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:49:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[260896e2-20e2-4abf-98bc-adbbe3ade004]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:53 user nova-compute[71354]: WARNING nova.compute.manager [req-ce250125-261f-4f21-a2e5-f27e3f6feffa req-5dd7cb76-881e-42e5-a5a9-f22d346bf359 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 17:49:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26232656338646235', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232656338646235', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'flavor' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:49:53 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:49:53 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:49:53 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:49:53 user nova-compute[71354]:   <serial>5c44732c-d2f2-4383-895a-8ac2aeddeff9</serial>
Apr 13 17:49:53 user nova-compute[71354]: </disk>
Apr 13 17:49:53 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408178.7485533, 0243764f-846b-4675-9ea1-49d07b05cdb5 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:53 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] VM Stopped (Lifecycle Event)
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-be167e51-9a33-4904-92a9-047efbaf11cd None None] [instance: 0243764f-846b-4675-9ea1-49d07b05cdb5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:78:5c:7c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:49:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-22737fbb-03db-4169-befa-282a971726f1 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.618s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:55 user nova-compute[71354]: WARNING nova.compute.manager [req-732fe540-df5f-4000-af61-255e84a43346 req-b6a5ecc4-e0c6-401e-8bfc-10e617a0cd45 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 832e4b85-2c48-469d-a21e-c56cccfcabe4 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408195.2244337, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] VM Resumed (Lifecycle Event)
Apr 13 17:49:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance rebooted successfully.
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408195.224615, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:49:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] VM Started (Lifecycle Event)
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b82d319e-f568-4534-af89-df454d2d36c1 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.594s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:55 user nova-compute[71354]: INFO nova.compute.manager [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Rebuilding instance
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_requests' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'migration_context' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71354) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:56 user nova-compute[71354]: WARNING nova.compute.manager [req-3507d574-aca2-4345-8de9-ce85e5b6f8ec req-3e0cb099-d365-49d6-b92d-018cd5e0b7b9 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state rebuilding.
Apr 13 17:49:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance destroyed successfully.
Apr 13 17:49:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:57 user nova-compute[71354]: INFO nova.compute.manager [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Detaching volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:49:57 user nova-compute[71354]: INFO nova.virt.block_device [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attempting to driver detach volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9 from mountpoint /dev/vdb
Apr 13 17:49:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Attempting to detach device vdb from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:49:57 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:49:57 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:49:57 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:49:57 user nova-compute[71354]:   <serial>5c44732c-d2f2-4383-895a-8ac2aeddeff9</serial>
Apr 13 17:49:57 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:49:57 user nova-compute[71354]: </disk>
Apr 13 17:49:57 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:49:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully detached device vdb from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the persistent domain config.
Apr 13 17:49:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:57 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b98f9-6aea-4f59-8624-a03335e62c97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:49:57 user nova-compute[71354]: No targets found.
Apr 13 17:49:57 user nova-compute[71354]: iSNS:
Apr 13 17:49:57 user nova-compute[71354]: No targets found.
Apr 13 17:49:57 user nova-compute[71354]: STATIC:
Apr 13 17:49:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44
Apr 13 17:49:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:49:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:49:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:49:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:49:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:49:57 user nova-compute[71354]: FIRMWARE:
Apr 13 17:49:57 user nova-compute[71354]: No targets found.
Apr 13 17:49:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:49:57 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:49:57 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ae0a2-293c-442c-a0a4-72f4c6e9155d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93589217-ece2-424f-a843-7930eb5e1a87]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:57 user nova-compute[71354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:49:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:57 user nova-compute[71354]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:49:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da799b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58976c-19db-4e4c-952f-7c0ed6dd7fd7]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[410411ba-79fb-4297-a310-b9295b35886c]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[915336b7-d53e-4104-a00d-59c70c0864b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a51d4d1-3e0d-49ba-997a-8e1ed8b88901]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacab7c-cf8a-4131-ad93-fbea6e51cc62]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2b10b-6cbf-4427-b12d-0d23125f13a2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]
Apr 13 17:49:57 user nova-compute[71354]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.
Apr 13 17:49:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c852bd-e8e2-4c65-af09-6466c1bad250]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (399ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:49:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance destroyed successfully.
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067fbe09-ac, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:49:58 user nova-compute[71354]: INFO os_vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f58142-e03d-4aa4-96e7-ca2df935ed2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:49:58 user nova-compute[71354]: No targets found.
Apr 13 17:49:58 user nova-compute[71354]: iSNS:
Apr 13 17:49:58 user nova-compute[71354]: No targets found.
Apr 13 17:49:58 user nova-compute[71354]: STATIC:
Apr 13 17:49:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44
Apr 13 17:49:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:49:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:49:58 user nova-compute[71354]: FIRMWARE:
Apr 13 17:49:58 user nova-compute[71354]: No targets found.
Apr 13 17:49:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:49:58 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:49:58 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[901aa504-371e-481b-abcf-47bde4331de6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:49:58 user nova-compute[71354]: WARNING nova.compute.manager [req-e15dc491-43da-474d-9c30-e7c976d39c12 req-d487c62d-51c3-4dea-8185-764040b95d5d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state rebuilding.
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8edf3-a07d-4dd3-a30b-bddcfd1468cf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:49:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da6b4c10>, {}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.101s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (103ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:49:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Deleting instance files /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_del
Apr 13 17:49:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Deletion of /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_del complete
Apr 13 17:49:58 user nova-compute[71354]: INFO nova.virt.block_device [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Booting with volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9 at /dev/vdb
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.utils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a82fa-14f2-4b7d-a6e0-3cbae9bbc802]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82ead4-4d1e-4d30-9af2-e960ab58d45d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b565d-1d54-439e-af2d-6b0ac73ddc6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7ed6a-4963-44b7-a883-fded053bfbc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:49:59 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:49:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e036a4-12bb-4b1b-a4a6-ace1029a68d1]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG os_brick.utils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:49:59 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating existing volume attachment record: 24877de8-9159-45aa-84df-b73e253bf389 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:50:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG nova.objects.instance [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'flavor' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:01 user nova-compute[71354]: INFO nova.compute.manager [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attaching volume 8ecd92a2-3a8e-4592-ab17-08f7c384c450 to /dev/vdb
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.utils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8e18c-bc8f-4ed0-b104-90a1bce36663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f63834-d379-4960-ac62-48aec4c274ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b354b42-6fb6-4543-a49f-6eb8cecd78ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d7a0ea-bc68-4cb1-9494-83c799cdc0f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:50:01 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:50:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d66270-cb4c-411f-ba68-cd61e935b37c]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG os_brick.utils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:50:01 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Updating existing volume attachment record: f71949e1-43df-4a33-917b-1a2838f51e6c {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:50:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408189.3992858, fd2c1fea-4a6b-4ccb-956a-d67282ecbb11 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:04 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] VM Stopped (Lifecycle Event)
Apr 13 17:50:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8afd54dc-167f-4ec1-8a88-4f0b35a42237 None None] [instance: fd2c1fea-4a6b-4ccb-956a-d67282ecbb11] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:50:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating image(s)
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk 1073741824" returned: 0 in 0.053s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.184s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Cannot resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Ensure instance console log exists: /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start _get_guest_xml network_info=[{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '24877de8-9159-45aa-84df-b73e253bf389', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08984ef0-6db9-4a60-b5b9-a6325ec531b1', 'attached_at': '', 'detached_at': '', 'volume_id': '5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'serial': '5c44732c-d2f2-4383-895a-8ac2aeddeff9'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:50:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 17:50:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:50:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:05 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d4099-ec3e-4355-830a-09f4c0109576]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:50:05 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8261ca-a3db-4534-8ea8-a4af1b9c9c6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9] added
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c46cf0-9aa3-440b-87af-99bcb9e6c7f6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9bd338-6b5f-48b7-8d89-a8a64e53a7b7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMJtDRkL {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMJtDRkL" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b74a1-4f95-4b24-8130-1aa3b15e6e18]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMJtDRkL'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b87bfe7-ea3c-4d80-9946-aa3679ce1c84]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c3db5-b56f-4387-b53f-3a30aed67839]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f041d47-ae58-46e9-ab67-a81ad4de17eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]
Apr 13 17:50:05 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060321e-be68-49e8-b2af-267b80420097]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74e117-4225-449c-9a6b-f7f78dfa71ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.044s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d02143-ed46-410a-976a-dd1ebfe3da4f]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:50:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:50:06 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26232656338646235', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232656338646235', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.146s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:06 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:06 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:50:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c91615-27bf-4708-b668-3521855b42ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:50:06 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:50:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:50:07 user nova-compute[71354]:   <uuid>08984ef0-6db9-4a60-b5b9-a6325ec531b1</uuid>
Apr 13 17:50:07 user nova-compute[71354]:   <name>instance-00000003</name>
Apr 13 17:50:07 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:50:07 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:50:07 user nova-compute[71354]:   <metadata>
Apr 13 17:50:07 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:50:07 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-127366011</nova:name>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:50:05</nova:creationTime>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:50:07 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:50:07 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:owner>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 17:50:07 user nova-compute[71354]:       </nova:owner>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:50:07 user nova-compute[71354]:       <nova:ports>
Apr 13 17:50:07 user nova-compute[71354]:         <nova:port uuid="067fbe09-ace1-4188-a99f-ee4847a1a311">
Apr 13 17:50:07 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:50:07 user nova-compute[71354]:         </nova:port>
Apr 13 17:50:07 user nova-compute[71354]:       </nova:ports>
Apr 13 17:50:07 user nova-compute[71354]:     </nova:instance>
Apr 13 17:50:07 user nova-compute[71354]:   </metadata>
Apr 13 17:50:07 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:50:07 user nova-compute[71354]:     <system>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="serial">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="uuid">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:50:07 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:50:07 user nova-compute[71354]:     </system>
Apr 13 17:50:07 user nova-compute[71354]:   </sysinfo>
Apr 13 17:50:07 user nova-compute[71354]:   <os>
Apr 13 17:50:07 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:50:07 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:50:07 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:50:07 user nova-compute[71354]:   </os>
Apr 13 17:50:07 user nova-compute[71354]:   <features>
Apr 13 17:50:07 user nova-compute[71354]:     <acpi/>
Apr 13 17:50:07 user nova-compute[71354]:     <apic/>
Apr 13 17:50:07 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:50:07 user nova-compute[71354]:   </features>
Apr 13 17:50:07 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:50:07 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:50:07 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:50:07 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:50:07 user nova-compute[71354]:   </clock>
Apr 13 17:50:07 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:50:07 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:50:07 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:50:07 user nova-compute[71354]:   </cpu>
Apr 13 17:50:07 user nova-compute[71354]:   <devices>
Apr 13 17:50:07 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:07 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:07 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk"/>
Apr 13 17:50:07 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:50:07 user nova-compute[71354]:     </disk>
Apr 13 17:50:07 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:50:07 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:50:07 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 17:50:07 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:50:07 user nova-compute[71354]:       <serial>5c44732c-d2f2-4383-895a-8ac2aeddeff9</serial>
Apr 13 17:50:07 user nova-compute[71354]:     </disk>
Apr 13 17:50:07 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:50:07 user nova-compute[71354]:       <mac address="fa:16:3e:78:5c:7c"/>
Apr 13 17:50:07 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:07 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:50:07 user nova-compute[71354]:       <target dev="tap067fbe09-ac"/>
Apr 13 17:50:07 user nova-compute[71354]:     </interface>
Apr 13 17:50:07 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:50:07 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log" append="off"/>
Apr 13 17:50:07 user nova-compute[71354]:     </serial>
Apr 13 17:50:07 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:50:07 user nova-compute[71354]:     <video>
Apr 13 17:50:07 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:07 user nova-compute[71354]:     </video>
Apr 13 17:50:07 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:50:07 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:50:07 user nova-compute[71354]:     </rng>
Apr 13 17:50:07 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:50:07 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:50:07 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:50:07 user nova-compute[71354]:     </memballoon>
Apr 13 17:50:07 user nova-compute[71354]:   </devices>
Apr 13 17:50:07 user nova-compute[71354]: </domain>
Apr 13 17:50:07 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067fbe09-ac, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067fbe09-ac, col_values=(('external_ids', {'iface-id': '067fbe09-ace1-4188-a99f-ee4847a1a311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5c:7c', 'vm-uuid': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6adc6f2-bae0-4b1d-89cc-e1e36b1efd5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450] added
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:07 user nova-compute[71354]: INFO os_vif [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71634bfc-08ea-44bd-af41-c6e013083df6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2513464-0249-403b-ae7a-cacfc84c09cf]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCBlEJw {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCBlEJw" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0b68b-50ec-40e6-9dc4-2b5304fe02c0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUCBlEJw'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ebcd88-a19c-432c-ba98-a2173de867d5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:78:5c:7c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b4ed8-6601-4379-b7cd-df9c453bf3cc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e2a74-9e65-4941-af84-179732f321bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260]
Apr 13 17:50:07 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260] successful.
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e89b0-c2e5-440e-be81-76b27a8e4205]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea787d8b-be11-426d-b22f-d2417998aaa5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:50:07 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[06759a34-0972-474e-81d1-a8e7ca482b2c]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:50:07 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] <== connect_volume: return (1564ms) {'type': 'block', 'scsi_wwn': '23265316264303736', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265316264303736', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG nova.objects.instance [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'flavor' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:50:08 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:50:08 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:50:08 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:50:08 user nova-compute[71354]:   <serial>8ecd92a2-3a8e-4592-ab17-08f7c384c450</serial>
Apr 13 17:50:08 user nova-compute[71354]: </disk>
Apr 13 17:50:08 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:08 user nova-compute[71354]: WARNING nova.compute.manager [req-148c5451-0802-4bf0-a99e-07e4c4c54e40 req-9c128c58-00de-4f2b-bcae-0b0f683ed14d service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 17:50:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No VIF found with MAC fa:16:3e:ae:a9:e8, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-94ac855c-3e2c-4636-ae12-92412f170289 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.716s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:09 user nova-compute[71354]: INFO nova.compute.manager [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Rescuing
Apr 13 17:50:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:50:10 user nova-compute[71354]: INFO nova.compute.claims [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Claim successful on node user
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:10 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:11 user nova-compute[71354]: WARNING nova.compute.manager [req-e56231fe-6fab-49b5-a5fc-489411f9d085 req-5c5a5031-9130-4e59-9a43-49d02de0ae4e service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.compute.claims [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Claim successful on node user
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.policy [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Creating image(s)
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:11 user nova-compute[71354]: WARNING nova.compute.manager [req-a75728b6-c60c-4f76-91f3-3d0a2c133986 req-a8d7f76d-da21-4d74-82f7-093abc1fef18 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state active and task_state rescuing.
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 08984ef0-6db9-4a60-b5b9-a6325ec531b1 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408211.1863678, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Resumed (Lifecycle Event)
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance spawned successfully.
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408211.1983542, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Started (Lifecycle Event)
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk 1073741824" returned: 0 in 0.066s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.158s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Cannot resize image /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Ensure instance console log exists: /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 69605608-790d-49be-ab18-277549242bef] Instance destroyed successfully.
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attempting a stable device rescue
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.236s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71354) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Creating image(s)
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:50:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef3a144b-a294-4a91-a8b2-459fa74668b4 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.policy [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:50:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Creating image(s)
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.046s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.part --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.virt.images [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] ad21ab82-d8b1-45fb-a91a-338177c31b59 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.part /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Successfully created port: bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.part /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.converted" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk 1073741824" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.230s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:13 user nova-compute[71354]: WARNING nova.compute.manager [req-4ecabe8f-3cc7-4f4b-b624-acee1ba886cc req-da07a371-139a-4c9c-a2cb-2f0dacba2dd4 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state active and task_state rescuing.
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a,backing_fmt=raw /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a,backing_fmt=raw /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue" returned: 0 in 0.054s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "f6a8d6f0a5bfdf729fdaaadeb18637577773c89a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'migration_context' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start _get_guest_xml network_info=[{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "vif_mac": "fa:16:3e:ae:a9:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ad21ab82-d8b1-45fb-a91a-338177c31b59', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'f71949e1-43df-4a33-917b-1a2838f51e6c', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '69605608-790d-49be-ab18-277549242bef', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'serial': '8ecd92a2-3a8e-4592-ab17-08f7c384c450'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'resources' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Cannot resize image /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'numa_topology' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Ensure instance console log exists: /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:50:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:50:13 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32d1d2-6a25-4f29-b85c-cc06f9a17c73]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HUCBlEJw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 17:50:13 user nova-compute[71354]: node.name = iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450
Apr 13 17:50:13 user nova-compute[71354]: node.tpgt = -1
Apr 13 17:50:13 user nova-compute[71354]: node.startup = automatic
Apr 13 17:50:13 user nova-compute[71354]: node.leading_login = No
Apr 13 17:50:13 user nova-compute[71354]: iface.iscsi_ifacename = default
Apr 13 17:50:13 user nova-compute[71354]: iface.net_ifacename = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.ipaddress = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.prefix_len = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.hwaddress = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.transport_name = tcp
Apr 13 17:50:13 user nova-compute[71354]: iface.initiatorname = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.vlan_id = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.vlan_priority = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.vlan_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.iface_num = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.mtu = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.port = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.bootproto = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.subnet_mask = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.gateway = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_alt_client_id = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_dns = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_learn_iqn = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_vendor_id_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_vendor_id = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.dhcp_slp_da = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.fragmentation = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.gratuitous_arp = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.incoming_forwarding = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.tos_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.tos = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.ttl = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.delayed_ack = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.tcp_nagle = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.tcp_wsf_state = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.tcp_wsf = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.tcp_timer_scale = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.tcp_timestamp = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.redirect = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.def_task_mgmt_timeout = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.header_digest = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.data_digest = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.immediate_data = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.initial_r2t = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.data_seq_inorder = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.data_pdu_inorder = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.erl = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.max_receive_data_len = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.first_burst_len = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.max_outstanding_r2t = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.max_burst_len = 0
Apr 13 17:50:13 user nova-compute[71354]: iface.chap_auth = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.bidi_chap = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.strict_login_compliance = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.discovery_auth = <empty>
Apr 13 17:50:13 user nova-compute[71354]: iface.discovery_logout = <empty>
Apr 13 17:50:13 user nova-compute[71354]: node.discovery_address = <empty>
Apr 13 17:50:13 user nova-compute[71354]: node.discovery_port = 0
Apr 13 17:50:13 user nova-compute[71354]: node.discovery_type = static
Apr 13 17:50:13 user nova-compute[71354]: node.session.initial_cmdsn = 0
Apr 13 17:50:13 user nova-compute[71354]: node.session.initial_login_retry_max = 8
Apr 13 17:50:13 user nova-compute[71354]: node.session.xmit_thread_priority = -20
Apr 13 17:50:13 user nova-compute[71354]: node.session.cmds_max = 128
Apr 13 17:50:13 user nova-compute[71354]: node.session.queue_depth = 32
Apr 13 17:50:13 user nova-compute[71354]: node.session.nr_sessions = 1
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.authmethod = CHAP
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.username = HUCBlEJw
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.password = ***
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.username_in = <empty>
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.password_in = <empty>
Apr 13 17:50:13 user nova-compute[71354]: node.session.auth.chap_algs = MD5
Apr 13 17:50:13 user nova-compute[71354]: node.session.timeo.replacement_timeout = 120
Apr 13 17:50:13 user nova-compute[71354]: node.session.err_timeo.abort_timeout = 15
Apr 13 17:50:13 user nova-compute[71354]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 17:50:13 user nova-compute[71354]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 17:50:13 user nova-compute[71354]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.FastAbort = Yes
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.InitialR2T = No
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.ImmediateData = Yes
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.MaxConnections = 1
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 17:50:13 user nova-compute[71354]: node.session.iscsi.ERL = 0
Apr 13 17:50:13 user nova-compute[71354]: node.session.scan = manual
Apr 13 17:50:13 user nova-compute[71354]: node.session.reopen_max = 0
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].address = 172.16.0.220
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].port = 3260
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].startup = manual
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].tcp.window_size = 524288
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].tcp.type_of_service = 0
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].timeo.logout_timeout = 15
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].timeo.login_timeout = 15
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].timeo.auth_timeout = 45
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.DataDigest = None
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.IFMarker = No
Apr 13 17:50:13 user nova-compute[71354]: node.conn[0].iscsi.OFMarker = No
Apr 13 17:50:13 user nova-compute[71354]: # END RECORD
Apr 13 17:50:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6878c03e-b36b-490d-9a79-0939573b47f9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3c2ed-947a-4122-a21f-c7a293d4f4bb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCBlEJw {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUCBlEJw" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0532dede-6ada-4c1f-943a-4c955cc5c17f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUCBlEJw'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb29051-024b-46cd-aa4b-8ca815b092e3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c35e7-7661-45c1-9aa1-16ff74354533]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:50:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] HCTL ('35', '0', '0', 0) found on session 18 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2eec50-2589-4754-995a-4ddeea386513]: (4, ('0 0 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Searching for a device in session 18 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.224s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] <== connect_volume: return (226ms) {'type': 'block', 'scsi_wwn': '23265316264303736', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265316264303736', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-547648089',display_name='tempest-ServerStableDeviceRescueTest-server-547648089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-547648089',id=5,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+Qp1DpGYd28SffPEL0KXHEyGVeNEzd/4SaNj92SqYaC3oPsix558denqtUGb8CVqhKclqMvdjbWzCvn1ComQgDM/fgeBZ91Z9GAUCB0F7d60nu+OvCRg4Monp5Wob+A==',key_name='tempest-keypair-1772761791',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='984a0fd6f48449a7ba8f9944243580b9',ramdisk_id='',reservation_id='r-974o4k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1535501044',owner_user_name='tempest-ServerStableDeviceRescueTest-1535501044-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbea54954e534fdc933b94936a47a0b3',uuid=69605608-790d-49be-ab18-277549242bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "vif_mac": "fa:16:3e:ae:a9:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converting VIF {"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "vif_mac": "fa:16:3e:ae:a9:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'pci_devices' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:50:13 user nova-compute[71354]:   <uuid>69605608-790d-49be-ab18-277549242bef</uuid>
Apr 13 17:50:13 user nova-compute[71354]:   <name>instance-00000005</name>
Apr 13 17:50:13 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:50:13 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:50:13 user nova-compute[71354]:   <metadata>
Apr 13 17:50:13 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:50:13 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-547648089</nova:name>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:50:13</nova:creationTime>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:50:13 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:50:13 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:owner>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:user uuid="cbea54954e534fdc933b94936a47a0b3">tempest-ServerStableDeviceRescueTest-1535501044-project-member</nova:user>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:project uuid="984a0fd6f48449a7ba8f9944243580b9">tempest-ServerStableDeviceRescueTest-1535501044</nova:project>
Apr 13 17:50:13 user nova-compute[71354]:       </nova:owner>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:50:13 user nova-compute[71354]:       <nova:ports>
Apr 13 17:50:13 user nova-compute[71354]:         <nova:port uuid="29f94d48-0d45-4fe8-b310-e02fb491f42f">
Apr 13 17:50:13 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:50:13 user nova-compute[71354]:         </nova:port>
Apr 13 17:50:13 user nova-compute[71354]:       </nova:ports>
Apr 13 17:50:13 user nova-compute[71354]:     </nova:instance>
Apr 13 17:50:13 user nova-compute[71354]:   </metadata>
Apr 13 17:50:13 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:50:13 user nova-compute[71354]:     <system>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="serial">69605608-790d-49be-ab18-277549242bef</entry>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="uuid">69605608-790d-49be-ab18-277549242bef</entry>
Apr 13 17:50:13 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:50:13 user nova-compute[71354]:     </system>
Apr 13 17:50:13 user nova-compute[71354]:   </sysinfo>
Apr 13 17:50:13 user nova-compute[71354]:   <os>
Apr 13 17:50:13 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:50:13 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:50:13 user nova-compute[71354]:   </os>
Apr 13 17:50:13 user nova-compute[71354]:   <features>
Apr 13 17:50:13 user nova-compute[71354]:     <acpi/>
Apr 13 17:50:13 user nova-compute[71354]:     <apic/>
Apr 13 17:50:13 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:50:13 user nova-compute[71354]:   </features>
Apr 13 17:50:13 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:50:13 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:50:13 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:50:13 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:50:13 user nova-compute[71354]:   </clock>
Apr 13 17:50:13 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:50:13 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:50:13 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:50:13 user nova-compute[71354]:   </cpu>
Apr 13 17:50:13 user nova-compute[71354]:   <devices>
Apr 13 17:50:13 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:13 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:13 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk"/>
Apr 13 17:50:13 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:50:13 user nova-compute[71354]:     </disk>
Apr 13 17:50:13 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:50:13 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:50:13 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 17:50:13 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:50:13 user nova-compute[71354]:       <serial>8ecd92a2-3a8e-4592-ab17-08f7c384c450</serial>
Apr 13 17:50:13 user nova-compute[71354]:     </disk>
Apr 13 17:50:13 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:13 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:13 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue"/>
Apr 13 17:50:13 user nova-compute[71354]:       <target dev="vdc" bus="virtio"/>
Apr 13 17:50:13 user nova-compute[71354]:       <boot order="1"/>
Apr 13 17:50:13 user nova-compute[71354]:     </disk>
Apr 13 17:50:13 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:50:13 user nova-compute[71354]:       <mac address="fa:16:3e:ae:a9:e8"/>
Apr 13 17:50:13 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:13 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:50:13 user nova-compute[71354]:       <target dev="tap29f94d48-0d"/>
Apr 13 17:50:13 user nova-compute[71354]:     </interface>
Apr 13 17:50:13 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:50:13 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/console.log" append="off"/>
Apr 13 17:50:13 user nova-compute[71354]:     </serial>
Apr 13 17:50:13 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:50:13 user nova-compute[71354]:     <video>
Apr 13 17:50:13 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:13 user nova-compute[71354]:     </video>
Apr 13 17:50:13 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:50:13 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:50:13 user nova-compute[71354]:     </rng>
Apr 13 17:50:13 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:50:13 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:50:13 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:50:13 user nova-compute[71354]:     </memballoon>
Apr 13 17:50:13 user nova-compute[71354]:   </devices>
Apr 13 17:50:13 user nova-compute[71354]: </domain>
Apr 13 17:50:13 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 69605608-790d-49be-ab18-277549242bef] Instance destroyed successfully.
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] No VIF found with MAC fa:16:3e:ae:a9:e8, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Successfully created port: 1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Successfully updated port: bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-changed-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Refreshing instance network info cache due to event network-changed-bc084ec2-1969-42ed-a2d1-1e157a83f6ac. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance network_info: |[{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Refreshing network info cache for port bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start _get_guest_xml network_info=[{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:50:15 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:15 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-787905959',display_name='tempest-ServerRescueNegativeTestJSON-server-787905959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-787905959',id=16,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-3jyfpoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:11Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=474af9f8-6700-4288-8133-a8dad4cf8a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Successfully updated port: 1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:15 user nova-compute[71354]: WARNING nova.compute.manager [req-b3a1a8ba-2cf1-4017-8c4e-da4ab6a88fe0 req-f4651d9e-90c3-48d1-8c3b-30cd0822928a service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state active and task_state rescuing.
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:50:15 user nova-compute[71354]:   <uuid>474af9f8-6700-4288-8133-a8dad4cf8a88</uuid>
Apr 13 17:50:15 user nova-compute[71354]:   <name>instance-00000010</name>
Apr 13 17:50:15 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:50:15 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:50:15 user nova-compute[71354]:   <metadata>
Apr 13 17:50:15 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:50:15 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-787905959</nova:name>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:50:15</nova:creationTime>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:50:15 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:50:15 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:owner>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 17:50:15 user nova-compute[71354]:       </nova:owner>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:50:15 user nova-compute[71354]:       <nova:ports>
Apr 13 17:50:15 user nova-compute[71354]:         <nova:port uuid="bc084ec2-1969-42ed-a2d1-1e157a83f6ac">
Apr 13 17:50:15 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:50:15 user nova-compute[71354]:         </nova:port>
Apr 13 17:50:15 user nova-compute[71354]:       </nova:ports>
Apr 13 17:50:15 user nova-compute[71354]:     </nova:instance>
Apr 13 17:50:15 user nova-compute[71354]:   </metadata>
Apr 13 17:50:15 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:50:15 user nova-compute[71354]:     <system>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="serial">474af9f8-6700-4288-8133-a8dad4cf8a88</entry>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="uuid">474af9f8-6700-4288-8133-a8dad4cf8a88</entry>
Apr 13 17:50:15 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:50:15 user nova-compute[71354]:     </system>
Apr 13 17:50:15 user nova-compute[71354]:   </sysinfo>
Apr 13 17:50:15 user nova-compute[71354]:   <os>
Apr 13 17:50:15 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:50:15 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:50:15 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:50:15 user nova-compute[71354]:   </os>
Apr 13 17:50:15 user nova-compute[71354]:   <features>
Apr 13 17:50:15 user nova-compute[71354]:     <acpi/>
Apr 13 17:50:15 user nova-compute[71354]:     <apic/>
Apr 13 17:50:15 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:50:15 user nova-compute[71354]:   </features>
Apr 13 17:50:15 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:50:15 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:50:15 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:50:15 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:50:15 user nova-compute[71354]:   </clock>
Apr 13 17:50:15 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:50:15 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:50:15 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:50:15 user nova-compute[71354]:   </cpu>
Apr 13 17:50:15 user nova-compute[71354]:   <devices>
Apr 13 17:50:15 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:15 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:15 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk"/>
Apr 13 17:50:15 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:50:15 user nova-compute[71354]:     </disk>
Apr 13 17:50:15 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:50:15 user nova-compute[71354]:       <mac address="fa:16:3e:23:6c:0c"/>
Apr 13 17:50:15 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:15 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:50:15 user nova-compute[71354]:       <target dev="tapbc084ec2-19"/>
Apr 13 17:50:15 user nova-compute[71354]:     </interface>
Apr 13 17:50:15 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:50:15 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/console.log" append="off"/>
Apr 13 17:50:15 user nova-compute[71354]:     </serial>
Apr 13 17:50:15 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:50:15 user nova-compute[71354]:     <video>
Apr 13 17:50:15 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:15 user nova-compute[71354]:     </video>
Apr 13 17:50:15 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:50:15 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:50:15 user nova-compute[71354]:     </rng>
Apr 13 17:50:15 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:50:15 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:50:15 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:50:15 user nova-compute[71354]:     </memballoon>
Apr 13 17:50:15 user nova-compute[71354]:   </devices>
Apr 13 17:50:15 user nova-compute[71354]: </domain>
Apr 13 17:50:15 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-787905959',display_name='tempest-ServerRescueNegativeTestJSON-server-787905959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-787905959',id=16,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-3jyfpoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:11Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=474af9f8-6700-4288-8133-a8dad4cf8a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG os_vif [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc084ec2-19, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc084ec2-19, col_values=(('external_ids', {'iface-id': 'bc084ec2-1969-42ed-a2d1-1e157a83f6ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:6c:0c', 'vm-uuid': '474af9f8-6700-4288-8133-a8dad4cf8a88'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:50:15 user nova-compute[71354]: INFO os_vif [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19')
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:23:6c:0c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance network_info: |[{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start _get_guest_xml network_info=[{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:50:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1565904434',display_name='tempest-ServerRescueNegativeTestJSON-server-1565904434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1565904434',id=17,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-epyvaovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:12Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=42e6a724-a30a-49db-8e06-fd1da3e57c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:50:16 user nova-compute[71354]:   <uuid>42e6a724-a30a-49db-8e06-fd1da3e57c6f</uuid>
Apr 13 17:50:16 user nova-compute[71354]:   <name>instance-00000011</name>
Apr 13 17:50:16 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:50:16 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:50:16 user nova-compute[71354]:   <metadata>
Apr 13 17:50:16 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:50:16 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1565904434</nova:name>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:50:16</nova:creationTime>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:50:16 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:50:16 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:owner>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 17:50:16 user nova-compute[71354]:       </nova:owner>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:50:16 user nova-compute[71354]:       <nova:ports>
Apr 13 17:50:16 user nova-compute[71354]:         <nova:port uuid="1264cd6a-928d-4e98-808e-0911f5498d48">
Apr 13 17:50:16 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:50:16 user nova-compute[71354]:         </nova:port>
Apr 13 17:50:16 user nova-compute[71354]:       </nova:ports>
Apr 13 17:50:16 user nova-compute[71354]:     </nova:instance>
Apr 13 17:50:16 user nova-compute[71354]:   </metadata>
Apr 13 17:50:16 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:50:16 user nova-compute[71354]:     <system>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="serial">42e6a724-a30a-49db-8e06-fd1da3e57c6f</entry>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="uuid">42e6a724-a30a-49db-8e06-fd1da3e57c6f</entry>
Apr 13 17:50:16 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:50:16 user nova-compute[71354]:     </system>
Apr 13 17:50:16 user nova-compute[71354]:   </sysinfo>
Apr 13 17:50:16 user nova-compute[71354]:   <os>
Apr 13 17:50:16 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:50:16 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:50:16 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:50:16 user nova-compute[71354]:   </os>
Apr 13 17:50:16 user nova-compute[71354]:   <features>
Apr 13 17:50:16 user nova-compute[71354]:     <acpi/>
Apr 13 17:50:16 user nova-compute[71354]:     <apic/>
Apr 13 17:50:16 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:50:16 user nova-compute[71354]:   </features>
Apr 13 17:50:16 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:50:16 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:50:16 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:50:16 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:50:16 user nova-compute[71354]:   </clock>
Apr 13 17:50:16 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:50:16 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:50:16 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:50:16 user nova-compute[71354]:   </cpu>
Apr 13 17:50:16 user nova-compute[71354]:   <devices>
Apr 13 17:50:16 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:16 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:16 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk"/>
Apr 13 17:50:16 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:50:16 user nova-compute[71354]:     </disk>
Apr 13 17:50:16 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:50:16 user nova-compute[71354]:       <mac address="fa:16:3e:c7:81:72"/>
Apr 13 17:50:16 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:16 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:50:16 user nova-compute[71354]:       <target dev="tap1264cd6a-92"/>
Apr 13 17:50:16 user nova-compute[71354]:     </interface>
Apr 13 17:50:16 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:50:16 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/console.log" append="off"/>
Apr 13 17:50:16 user nova-compute[71354]:     </serial>
Apr 13 17:50:16 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:50:16 user nova-compute[71354]:     <video>
Apr 13 17:50:16 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:16 user nova-compute[71354]:     </video>
Apr 13 17:50:16 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:50:16 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:50:16 user nova-compute[71354]:     </rng>
Apr 13 17:50:16 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:50:16 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:50:16 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:50:16 user nova-compute[71354]:     </memballoon>
Apr 13 17:50:16 user nova-compute[71354]:   </devices>
Apr 13 17:50:16 user nova-compute[71354]: </domain>
Apr 13 17:50:16 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1565904434',display_name='tempest-ServerRescueNegativeTestJSON-server-1565904434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1565904434',id=17,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-epyvaovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:12Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=42e6a724-a30a-49db-8e06-fd1da3e57c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG os_vif [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1264cd6a-92, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1264cd6a-92, col_values=(('external_ids', {'iface-id': '1264cd6a-928d-4e98-808e-0911f5498d48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:81:72', 'vm-uuid': '42e6a724-a30a-49db-8e06-fd1da3e57c6f'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: INFO os_vif [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92')
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updated VIF entry in instance network info cache for port bc084ec2-1969-42ed-a2d1-1e157a83f6ac. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-aa2156c8-c597-4e61-82fb-b45aef6ec57b req-d91b3329-5772-4938-9cf3-9ae29d55bb4b service nova] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:c7:81:72, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-changed-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Refreshing instance network info cache due to event network-changed-1264cd6a-928d-4e98-808e-0911f5498d48. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Acquiring lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Acquired lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Refreshing network info cache for port 1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updated VIF entry in instance network info cache for port 1264cd6a-928d-4e98-808e-0911f5498d48. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-42ea1a69-a4c5-4651-954f-3517815e0e31 req-bee031fd-8008-4470-9f75-67e00a245ee3 service nova] Releasing lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:17 user nova-compute[71354]: WARNING nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state active and task_state rescuing.
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:17 user nova-compute[71354]: WARNING nova.compute.manager [req-899269a9-63f0-4360-9347-a7ef0e3fa2cc req-f4cacf1c-17b0-4571-9178-4d5996499682 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state building and task_state spawning.
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 69605608-790d-49be-ab18-277549242bef due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408217.9033825, 69605608-790d-49be-ab18-277549242bef => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:17 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Resumed (Lifecycle Event)
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-cb7e45e8-3f4d-4eeb-9f35-477d8a855ddb tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:17 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 17:50:17 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408217.9081464, 69605608-790d-49be-ab18-277549242bef => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:17 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Started (Lifecycle Event)
Apr 13 17:50:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:19 user nova-compute[71354]: WARNING nova.compute.manager [req-43b6dfc0-4991-4fd1-b4e4-086fab7d1568 req-fc634b89-82d6-48a5-bf86-0ee8a62db81d service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state building and task_state spawning.
Apr 13 17:50:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:19 user nova-compute[71354]: WARNING nova.compute.manager [req-c8b90403-3b60-43a3-a4cf-36a350ad47cc req-d3996e11-41a7-491d-b921-ab1a0c81d303 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state building and task_state spawning.
Apr 13 17:50:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:50:20 user nova-compute[71354]: INFO nova.compute.claims [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Claim successful on node user
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:50:20 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.policy [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Creating image(s)
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:21 user nova-compute[71354]: WARNING nova.compute.manager [req-9ab398e3-58d9-45e6-b734-f25828bbc146 req-e23e24c3-a8de-4549-bd5e-b13ed4c94405 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state building and task_state spawning.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408221.4891362, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Resumed (Lifecycle Event)
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance spawned successfully.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk 1073741824" returned: 0 in 0.104s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance spawned successfully.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408221.4900172, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Started (Lifecycle Event)
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Successfully created port: 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408221.7026827, 42e6a724-a30a-49db-8e06-fd1da3e57c6f => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] VM Resumed (Lifecycle Event)
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.217s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Took 10.91 seconds to spawn the instance on the hypervisor.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408221.7028496, 42e6a724-a30a-49db-8e06-fd1da3e57c6f => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] VM Started (Lifecycle Event)
Apr 13 17:50:22 user nova-compute[71354]: INFO nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Took 9.35 seconds to spawn the instance on the hypervisor.
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Cannot resize image /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'migration_context' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:22 user nova-compute[71354]: INFO nova.compute.manager [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Took 11.91 seconds to build instance.
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Ensure instance console log exists: /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:22 user nova-compute[71354]: INFO nova.compute.manager [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Took 11.14 seconds to build instance.
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4de453fb-a14b-4c0d-84d9-1374c16105df tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.029s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-994aeac2-2903-46b6-a2b1-a0c57f033632 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.292s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Successfully updated port: 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-changed-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing instance network info cache due to event network-changed-72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance network_info: |[{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing network info cache for port 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start _get_guest_xml network_info=[{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:50:23 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:23 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqZOy7olKGfFEjGGEPUTWiwXJI6g8Pqj8VfYP7qUXA0qO+ggL6RxnieeiumVfVpIKABKlrT7FLRvV7y281BJMwrmjY6lnjk387cGRy7pkcY03EjqW+oukCEfTzjIpGsQ==',key_name='tempest-keypair-142800183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_devices' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:50:23 user nova-compute[71354]:   <uuid>1753314b-bfd7-4e8b-986b-0253666ab8aa</uuid>
Apr 13 17:50:23 user nova-compute[71354]:   <name>instance-00000012</name>
Apr 13 17:50:23 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:50:23 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:50:23 user nova-compute[71354]:   <metadata>
Apr 13 17:50:23 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:50:23 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1379597542</nova:name>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:50:23</nova:creationTime>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:50:23 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:50:23 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:owner>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:user uuid="6be9926ecd1d45d89aba2e65ac3e0bfc">tempest-AttachVolumeShelveTestJSON-1896381340-project-member</nova:user>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:project uuid="c3589c01630f4f83a6925d97943c574b">tempest-AttachVolumeShelveTestJSON-1896381340</nova:project>
Apr 13 17:50:23 user nova-compute[71354]:       </nova:owner>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:50:23 user nova-compute[71354]:       <nova:ports>
Apr 13 17:50:23 user nova-compute[71354]:         <nova:port uuid="72193ca5-011d-4cf8-b016-194d83952281">
Apr 13 17:50:23 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:50:23 user nova-compute[71354]:         </nova:port>
Apr 13 17:50:23 user nova-compute[71354]:       </nova:ports>
Apr 13 17:50:23 user nova-compute[71354]:     </nova:instance>
Apr 13 17:50:23 user nova-compute[71354]:   </metadata>
Apr 13 17:50:23 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:50:23 user nova-compute[71354]:     <system>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="serial">1753314b-bfd7-4e8b-986b-0253666ab8aa</entry>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="uuid">1753314b-bfd7-4e8b-986b-0253666ab8aa</entry>
Apr 13 17:50:23 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:50:23 user nova-compute[71354]:     </system>
Apr 13 17:50:23 user nova-compute[71354]:   </sysinfo>
Apr 13 17:50:23 user nova-compute[71354]:   <os>
Apr 13 17:50:23 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:50:23 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:50:23 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:50:23 user nova-compute[71354]:   </os>
Apr 13 17:50:23 user nova-compute[71354]:   <features>
Apr 13 17:50:23 user nova-compute[71354]:     <acpi/>
Apr 13 17:50:23 user nova-compute[71354]:     <apic/>
Apr 13 17:50:23 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:50:23 user nova-compute[71354]:   </features>
Apr 13 17:50:23 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:50:23 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:50:23 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:50:23 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:50:23 user nova-compute[71354]:   </clock>
Apr 13 17:50:23 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:50:23 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:50:23 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:50:23 user nova-compute[71354]:   </cpu>
Apr 13 17:50:23 user nova-compute[71354]:   <devices>
Apr 13 17:50:23 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:50:23 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:50:23 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk"/>
Apr 13 17:50:23 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:50:23 user nova-compute[71354]:     </disk>
Apr 13 17:50:23 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:50:23 user nova-compute[71354]:       <mac address="fa:16:3e:9b:5a:72"/>
Apr 13 17:50:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:23 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:50:23 user nova-compute[71354]:       <target dev="tap72193ca5-01"/>
Apr 13 17:50:23 user nova-compute[71354]:     </interface>
Apr 13 17:50:23 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:50:23 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/console.log" append="off"/>
Apr 13 17:50:23 user nova-compute[71354]:     </serial>
Apr 13 17:50:23 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:50:23 user nova-compute[71354]:     <video>
Apr 13 17:50:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:50:23 user nova-compute[71354]:     </video>
Apr 13 17:50:23 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:50:23 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:50:23 user nova-compute[71354]:     </rng>
Apr 13 17:50:23 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:50:23 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:50:23 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:50:23 user nova-compute[71354]:     </memballoon>
Apr 13 17:50:23 user nova-compute[71354]:   </devices>
Apr 13 17:50:23 user nova-compute[71354]: </domain>
Apr 13 17:50:23 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqZOy7olKGfFEjGGEPUTWiwXJI6g8Pqj8VfYP7qUXA0qO+ggL6RxnieeiumVfVpIKABKlrT7FLRvV7y281BJMwrmjY6lnjk387cGRy7pkcY03EjqW+oukCEfTzjIpGsQ==',key_name='tempest-keypair-142800183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG os_vif [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72193ca5-01, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72193ca5-01, col_values=(('external_ids', {'iface-id': '72193ca5-011d-4cf8-b016-194d83952281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5a:72', 'vm-uuid': '1753314b-bfd7-4e8b-986b-0253666ab8aa'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:23 user nova-compute[71354]: INFO os_vif [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01')
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No VIF found with MAC fa:16:3e:9b:5a:72, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updated VIF entry in instance network info cache for port 72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-72ba687a-540d-4cc6-aaec-1b499230ea15 req-3faabb2f-d215-4fcf-8510-900c31b6925f service nova] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:25 user nova-compute[71354]: WARNING nova.compute.manager [req-f5a4651d-ebf0-47d6-a024-12adb7c02d36 req-5ea146bb-c9ee-4fe3-9627-65083b874f84 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state building and task_state spawning.
Apr 13 17:50:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:50:27 user nova-compute[71354]: WARNING nova.compute.manager [req-287da201-a5f7-4cd5-8c8e-0582699ac4e7 req-827dbe42-d956-419a-930f-0eecd8016835 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state building and task_state spawning.
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408227.5163624, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Resumed (Lifecycle Event)
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance spawned successfully.
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408227.5178068, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Started (Lifecycle Event)
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Took 6.41 seconds to spawn the instance on the hypervisor.
Apr 13 17:50:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:50:27 user nova-compute[71354]: INFO nova.compute.manager [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Took 7.52 seconds to build instance.
Apr 13 17:50:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de752a5c-5314-441b-9cc9-6b06a1b01987 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.634s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:49 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:49 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7269MB free_disk=26.327877044677734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:50:49 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:50:50 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:50:50 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:50:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:50:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:52 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:50:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:53 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [{"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-85f8857e-9e9b-4a5a-912a-4d79014417d0" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:50:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:50:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-changed-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:50:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Refreshing instance network info cache due to event network-changed-723c0bf0-b727-4ff6-b9fe-2197b7609fa0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:50:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:50:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:50:55 user nova-compute[71354]: DEBUG nova.network.neutron [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Refreshing network info cache for port 723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:50:56 user nova-compute[71354]: DEBUG nova.network.neutron [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updated VIF entry in instance network info cache for port 723c0bf0-b727-4ff6-b9fe-2197b7609fa0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:50:56 user nova-compute[71354]: DEBUG nova.network.neutron [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:50:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-943212de-902b-4c7c-81f7-1cc9529c92fe req-4705cbb2-8cb9-4c97-a90b-bfb5024a7766 service nova] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:50:57 user nova-compute[71354]: INFO nova.compute.manager [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Attaching volume 101df4ac-9f5e-4960-85e3-ccb7dc4be985 to /dev/vdb
Apr 13 17:50:57 user nova-compute[71354]: DEBUG os_brick.utils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b5d82-67e8-484a-a302-76f9e1d78ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a83eeb0-62bb-4ea5-8eba-df685bdad523]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f89a3-573c-4d2c-9572-881cf3fb12dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa95aae-6c11-48a1-8b73-96211a963342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:50:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:50:58 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:50:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ba5f0-d37b-464f-a4bb-deea2c6e4a1d]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG os_brick.utils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating existing volume attachment record: edd6fc52-f563-4d3e-a480-adb4d999feba {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:50:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:51:02 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:51:02 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:51:02 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa26c3f-417c-4fb0-a418-4c47c5fb24a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:51:02 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e09c4-cb9d-4b94-96c3-40b91ea8991c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985] added
Apr 13 17:51:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf3334b-a471-48c1-b842-cef49fe046aa]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea534131-c0cb-408e-ab12-7acd97f8d1df]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvNZDMAy {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvNZDMAy" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b263d-f012-4114-9d2b-14a648595c5d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvNZDMAy'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e78b76f-e4e1-4ec2-a5cb-b6ce32febf51]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad564fe3-b8b9-42a7-921c-c6e7ee42e398]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161076c-cc36-4005-927f-6b271ff3170f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]
Apr 13 17:51:03 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.
Apr 13 17:51:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e5b5e3-832f-40bc-86fd-0bf0b0ec8d47]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a980a3-e73e-4e42-9e2a-2a2c6ff618e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c3646-1642-4354-94c3-26011bc6b81f]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23933313138383830', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933313138383830', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:51:04 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:51:04 user nova-compute[71354]:   <source dev="/dev/sde"/>
Apr 13 17:51:04 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:51:04 user nova-compute[71354]:   <serial>101df4ac-9f5e-4960-85e3-ccb7dc4be985</serial>
Apr 13 17:51:04 user nova-compute[71354]: </disk>
Apr 13 17:51:04 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:51:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No VIF found with MAC fa:16:3e:9b:e2:8a, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f7ab6dc9-2301-4766-ac49-4a3f54893354 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.366s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71354) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:06 user nova-compute[71354]: WARNING nova.compute.manager [req-215d38b1-fe15-4c14-80c8-afa459099abb req-f678aa89-da9b-4af6-888a-c3ade5b40e6c service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state active and task_state powering-off.
Apr 13 17:51:06 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance destroyed successfully.
Apr 13 17:51:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8a9f662b-9650-49da-8030-a4005358a870 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:08 user nova-compute[71354]: WARNING nova.compute.manager [req-bd4bc235-ed0d-450b-8ea9-66708e5bd6d8 req-e85410e6-2d60-49a8-89e9-aef3734eb855 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state None.
Apr 13 17:51:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:13 user nova-compute[71354]: INFO nova.compute.manager [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Terminating instance
Apr 13 17:51:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-unplugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] No waiting events found dispatching network-vif-unplugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-d0f94254-5933-418c-b72e-80f3a35b685d req-a0a51747-fea0-4b7e-a737-14eaff09bfcb service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-unplugged-919ef722-99b4-433d-9c37-e6ef30672421 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:51:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Instance destroyed successfully.
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'resources' on Instance uuid bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509906458',display_name='tempest-VolumesAdminNegativeTest-server-509906458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509906458',id=14,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-9218ii82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:49:27Z,user_data=None,user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "919ef722-99b4-433d-9c37-e6ef30672421", "address": "fa:16:3e:0b:a7:07", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ef722-99", "ovs_interfaceid": "919ef722-99b4-433d-9c37-e6ef30672421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG os_vif [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap919ef722-99, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:14 user nova-compute[71354]: INFO os_vif [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=919ef722-99b4-433d-9c37-e6ef30672421,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ef722-99')
Apr 13 17:51:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Deleting instance files /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84_del
Apr 13 17:51:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Deletion of /opt/stack/data/nova/instances/bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84_del complete
Apr 13 17:51:14 user nova-compute[71354]: INFO nova.compute.manager [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 17:51:14 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:51:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:51:14 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Took 0.76 seconds to deallocate network for instance.
Apr 13 17:51:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:15 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:51:15 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:51:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:15 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Deleted allocations for instance bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84
Apr 13 17:51:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-62496fc3-1d41-466d-958c-517299f490c8 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Acquiring lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] Lock "bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] No waiting events found dispatching network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:16 user nova-compute[71354]: WARNING nova.compute.manager [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received unexpected event network-vif-plugged-919ef722-99b4-433d-9c37-e6ef30672421 for instance with vm_state deleted and task_state None.
Apr 13 17:51:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-1cab0f67-4f73-4333-9ccf-1f4bbbbc7dcb req-4b1307e1-0730-4292-b7d3-63f07f4e595d service nova] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Received event network-vif-deleted-919ef722-99b4-433d-9c37-e6ef30672421 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:21 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408266.2763522, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:51:21 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Stopped (Lifecycle Event)
Apr 13 17:51:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3a603b4f-e47e-4ee9-a063-859a55563b19 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3a603b4f-e47e-4ee9-a063-859a55563b19 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:51:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:51:28 user nova-compute[71354]: INFO nova.compute.claims [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Claim successful on node user
Apr 13 17:51:28 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408274.0409067, bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:51:29 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] VM Stopped (Lifecycle Event)
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f32aebba-d30e-44e7-b3a7-27a4f0609c59 None None] [instance: bb331ebf-06f3-4a0d-94e2-6f13a6d8ae84] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:29 user nova-compute[71354]: INFO nova.virt.block_device [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Booting with volume 520be0ee-ea06-4b16-8773-a8d5b9e40c87 at /dev/vda
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.policy [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b8e4096bfa5458b81aa51dc55394cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1775be5ea4c540b0a67bfe3468fd5901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5084509-24e2-4c34-8b99-1312cf69d069]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b132b7-c731-460a-97e1-093b153cdb27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f36396b-bb6a-4cb6-bdd3-7c106207b01b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39a4d0-2dda-4f8c-afc4-4d721c7e2e60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:51:29 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:51:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363c092-667e-4192-8d8c-69c9430b6a2f]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating existing volume attachment record: a7eac552-bf57-4553-a363-bad325938c81 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:51:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Successfully created port: 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:51:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Successfully updated port: 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing instance network info cache due to event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.network.neutron [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance network_info: |[{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:51:31 user nova-compute[71354]: DEBUG nova.network.neutron [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:51:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updated VIF entry in instance network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:51:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:51:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-facae7fe-4384-4d68-ba2f-a674bdeb660d req-ece7dcd6-cb38-4727-8b4e-49c1b4aabf2d service nova] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:51:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:33 user nova-compute[71354]: INFO nova.compute.manager [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] instance snapshotting
Apr 13 17:51:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Beginning live snapshot process
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e.delta 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e.delta 1073741824" returned: 0 in 0.053s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 17:51:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:51:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Creating image(s)
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Ensure instance console log exists: /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start _get_guest_xml network_info=[{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'a7eac552-bf57-4553-a363-bad325938c81', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc1716d8-163a-4a50-8b3a-dbde50340fb8', 'attached_at': '', 'detached_at': '', 'volume_id': '520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'serial': '520be0ee-ea06-4b16-8773-a8d5b9e40c87'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:51:34 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:51:34 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:51:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:51:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:51:34 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de304764-4d71-49a9-b6b8-7aacebe09681]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:51:34 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b0f88-21c3-4bb4-9f52-b00dff5f10a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87] added
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e80c33-346e-4791-b2a6-96804b5bf4a1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b3eba-ad9f-4951-a6f7-6db85a323d4a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnhzMFwD {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnhzMFwD" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[973ae28f-da1b-4ae5-ba36-e6a887976b90]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PnhzMFwD'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f402db9-eab0-4cd1-80bf-6538c9c01ba8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d451fc-82fd-4e1a-8f53-c46e5f4aca89]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4aa911-af91-418c-bbc7-79eb033806ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]
Apr 13 17:51:34 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40bab45-fe1b-4d5f-a266-57e468711c2b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[705af66d-fc2a-425c-afa8-0149d9585047]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:51:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a841be7-1053-4f7e-8e92-43e002321cc8]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:51:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:51:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e.delta /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e.delta /opt/stack/data/nova/instances/snapshots/tmpjpjj28lq/0bf59229b2554729a45fad5f4be3b99e" returned: 0 in 0.448s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:35 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Snapshot extracted, beginning image upload
Apr 13 17:51:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26434353338303265', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353338303265', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+7fvwpKiIT941SPCbdY9x4Jev0kmNw794zuyTRCpHksjAYtGwMPWm/1jEY16x/UTkRyA96KR24i+FrqltRAjlx3KlYCS1QyCMn13CUYjLuHW0Kxt41qWBnmQAfLfVj5A==',key_name='tempest-TestShelveInstance-822246976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:51:29Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'pci_devices' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:51:35 user nova-compute[71354]:   <uuid>dc1716d8-163a-4a50-8b3a-dbde50340fb8</uuid>
Apr 13 17:51:35 user nova-compute[71354]:   <name>instance-00000013</name>
Apr 13 17:51:35 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:51:35 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:51:35 user nova-compute[71354]:   <metadata>
Apr 13 17:51:35 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:51:35 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:51:35 user nova-compute[71354]:       <nova:name>tempest-TestShelveInstance-server-1107166628</nova:name>
Apr 13 17:51:35 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:51:34</nova:creationTime>
Apr 13 17:51:35 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:51:35 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:51:35 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:51:35 user nova-compute[71354]:       <nova:owner>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:user uuid="8b8e4096bfa5458b81aa51dc55394cb9">tempest-TestShelveInstance-2002875852-project-member</nova:user>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:project uuid="1775be5ea4c540b0a67bfe3468fd5901">tempest-TestShelveInstance-2002875852</nova:project>
Apr 13 17:51:35 user nova-compute[71354]:       </nova:owner>
Apr 13 17:51:35 user nova-compute[71354]:       <nova:ports>
Apr 13 17:51:35 user nova-compute[71354]:         <nova:port uuid="8064fded-37fe-474e-bf38-2f6c094dd0d0">
Apr 13 17:51:35 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:51:35 user nova-compute[71354]:         </nova:port>
Apr 13 17:51:35 user nova-compute[71354]:       </nova:ports>
Apr 13 17:51:35 user nova-compute[71354]:     </nova:instance>
Apr 13 17:51:35 user nova-compute[71354]:   </metadata>
Apr 13 17:51:35 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:51:35 user nova-compute[71354]:     <system>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="serial">dc1716d8-163a-4a50-8b3a-dbde50340fb8</entry>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="uuid">dc1716d8-163a-4a50-8b3a-dbde50340fb8</entry>
Apr 13 17:51:35 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:51:35 user nova-compute[71354]:     </system>
Apr 13 17:51:35 user nova-compute[71354]:   </sysinfo>
Apr 13 17:51:35 user nova-compute[71354]:   <os>
Apr 13 17:51:35 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:51:35 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:51:35 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:51:35 user nova-compute[71354]:   </os>
Apr 13 17:51:35 user nova-compute[71354]:   <features>
Apr 13 17:51:35 user nova-compute[71354]:     <acpi/>
Apr 13 17:51:35 user nova-compute[71354]:     <apic/>
Apr 13 17:51:35 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:51:35 user nova-compute[71354]:   </features>
Apr 13 17:51:35 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:51:35 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:51:35 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:51:35 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:51:35 user nova-compute[71354]:   </clock>
Apr 13 17:51:35 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:51:35 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:51:35 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:51:35 user nova-compute[71354]:   </cpu>
Apr 13 17:51:35 user nova-compute[71354]:   <devices>
Apr 13 17:51:35 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:51:35 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:51:35 user nova-compute[71354]:       <source dev="/dev/sdf"/>
Apr 13 17:51:35 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:51:35 user nova-compute[71354]:       <serial>520be0ee-ea06-4b16-8773-a8d5b9e40c87</serial>
Apr 13 17:51:35 user nova-compute[71354]:     </disk>
Apr 13 17:51:35 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:51:35 user nova-compute[71354]:       <mac address="fa:16:3e:cc:87:cd"/>
Apr 13 17:51:35 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:51:35 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:51:35 user nova-compute[71354]:       <target dev="tap8064fded-37"/>
Apr 13 17:51:35 user nova-compute[71354]:     </interface>
Apr 13 17:51:35 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:51:35 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8/console.log" append="off"/>
Apr 13 17:51:35 user nova-compute[71354]:     </serial>
Apr 13 17:51:35 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:51:35 user nova-compute[71354]:     <video>
Apr 13 17:51:35 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:51:35 user nova-compute[71354]:     </video>
Apr 13 17:51:35 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:51:35 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:51:35 user nova-compute[71354]:     </rng>
Apr 13 17:51:35 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:51:35 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:51:35 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:51:35 user nova-compute[71354]:     </memballoon>
Apr 13 17:51:35 user nova-compute[71354]:   </devices>
Apr 13 17:51:35 user nova-compute[71354]: </domain>
Apr 13 17:51:35 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+7fvwpKiIT941SPCbdY9x4Jev0kmNw794zuyTRCpHksjAYtGwMPWm/1jEY16x/UTkRyA96KR24i+FrqltRAjlx3KlYCS1QyCMn13CUYjLuHW0Kxt41qWBnmQAfLfVj5A==',key_name='tempest-TestShelveInstance-822246976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:51:29Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG os_vif [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8064fded-37, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8064fded-37, col_values=(('external_ids', {'iface-id': '8064fded-37fe-474e-bf38-2f6c094dd0d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:87:cd', 'vm-uuid': 'dc1716d8-163a-4a50-8b3a-dbde50340fb8'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:35 user nova-compute[71354]: INFO os_vif [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37')
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:51:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] No VIF found with MAC fa:16:3e:cc:87:cd, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing instance network info cache due to event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updated VIF entry in instance network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:51:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e190dc0f-311d-4570-8eb9-d211d2d11594 req-6d29a7c4-c4dd-406e-b48a-e96f0d05f179 service nova] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:37 user nova-compute[71354]: WARNING nova.compute.manager [req-1a3c95b9-2bf8-4d4e-9db1-85f763d49d3c req-1f285672-46ff-41eb-8389-72bf313506c8 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state building and task_state spawning.
Apr 13 17:51:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:37 user nova-compute[71354]: INFO nova.compute.manager [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Detaching volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44
Apr 13 17:51:37 user nova-compute[71354]: INFO nova.virt.block_device [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Attempting to driver detach volume db7bdb03-7472-4dd3-85ee-680fb0fe5d44 from mountpoint /dev/vdb
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Attempting to detach device vdb from instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:51:37 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:51:37 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 17:51:37 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:51:37 user nova-compute[71354]:   <serial>db7bdb03-7472-4dd3-85ee-680fb0fe5d44</serial>
Apr 13 17:51:37 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:51:37 user nova-compute[71354]: </disk>
Apr 13 17:51:37 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:51:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully detached device vdb from instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 from the persistent domain config.
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:51:37 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:51:37 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 17:51:37 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:51:37 user nova-compute[71354]:   <serial>db7bdb03-7472-4dd3-85ee-680fb0fe5d44</serial>
Apr 13 17:51:37 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:51:37 user nova-compute[71354]: </disk>
Apr 13 17:51:37 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Snapshot image upload complete
Apr 13 17:51:37 user nova-compute[71354]: INFO nova.compute.manager [None req-a290c0da-af0d-4c3f-825b-09c1d25ccfea tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Took 4.93 seconds to snapshot the instance on the hypervisor.
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408298.1314983, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:51:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully detached device vdb from instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 from the live domain config.
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idMJSAnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:51:38 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f3ed6-7fa6-437c-ab86-44cc433012eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:51:38 user nova-compute[71354]: No targets found.
Apr 13 17:51:38 user nova-compute[71354]: iSNS:
Apr 13 17:51:38 user nova-compute[71354]: No targets found.
Apr 13 17:51:38 user nova-compute[71354]: STATIC:
Apr 13 17:51:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44
Apr 13 17:51:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:51:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:51:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:51:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:51:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:51:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:51:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:51:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:51:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450
Apr 13 17:51:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:51:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:51:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:51:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:51:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:51:38 user nova-compute[71354]: FIRMWARE:
Apr 13 17:51:38 user nova-compute[71354]: No targets found.
Apr 13 17:51:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:51:38 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:51:38 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[62761451-19b1-4980-a747-20c5d7719ac8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5afc032-5a01-4b41-99ed-270f7e753839]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:51:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc3c8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c2004-7586-4697-80b5-27e78ccba45b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a35e0d-2ca2-45cf-bec9-a6e9598fd2be]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7e8e81-941d-4c16-b992-84469eb1a62d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d74f2a-e534-4aac-ba2e-a55336d8a5f3]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4466ff-6b4b-4b05-9c52-aeb9fa74068e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90051a8b-1f65-42a1-9fbf-bc3ec4922224]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260]
Apr 13 17:51:38 user nova-compute[71354]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44, portal: 172.16.0.220,3260] successful.
Apr 13 17:51:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing instance network info cache due to event network-changed-7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Acquiring lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Acquired lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.network.neutron [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Refreshing network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7bdb03-7472-4dd3-85ee-680fb0fe5d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4b9a4-6725-46e3-8250-10468328e61a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== disconnect_volume: return (300ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.network.neutron [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updated VIF entry in instance network info cache for port 7c1fde03-37b1-418b-8a56-9d046c05a1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG nova.network.neutron [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [{"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:51:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77ab5951-ddf6-4bea-85b8-ea7c4f77ad66 req-8f978bde-ebec-46b3-8856-85bc8ce6df08 service nova] Releasing lock "refresh_cache-832e4b85-2c48-469d-a21e-c56cccfcabe4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9db9ccf9-226b-4231-9d23-886cbaaf23b4 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.741s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408299.3395495, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Resumed (Lifecycle Event)
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance spawned successfully.
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408299.3408191, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Started (Lifecycle Event)
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Took 5.15 seconds to spawn the instance on the hypervisor.
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:51:39 user nova-compute[71354]: INFO nova.compute.manager [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Took 10.95 seconds to build instance.
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:51:39 user nova-compute[71354]: WARNING nova.compute.manager [req-d279d412-4f7d-4162-942a-7f5d1444c99f req-a175ac0d-0cc4-4e0f-a6a4-644693ed0f13 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state active and task_state None.
Apr 13 17:51:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-68d5bc76-c678-47eb-b67e-a29dd9462efe tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.053s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:51:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:51:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:51:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:51:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=26.306209564208984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:51:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:51:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:51:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:51:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:00 user nova-compute[71354]: INFO nova.compute.manager [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Unrescuing
Apr 13 17:52:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:00 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:52:00 user nova-compute[71354]: INFO nova.compute.manager [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Rescuing
Apr 13 17:52:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:00 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:52:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'flavor' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:01 user nova-compute[71354]: DEBUG nova.compute.manager [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:01 user nova-compute[71354]: WARNING nova.compute.manager [req-2fb8b3ef-5b50-4598-a447-0fca945f226b req-9b60d6be-20c9-40ac-895d-e7b09394c0a1 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:52:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:02 user nova-compute[71354]: WARNING nova.compute.manager [req-f8e0bb01-5d8d-43d3-92ae-fe79cc0f33b2 req-315d7686-5265-4410-aa9e-e0b8a54ec2ec service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state active and task_state rescuing.
Apr 13 17:52:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 69605608-790d-49be-ab18-277549242bef] Instance destroyed successfully.
Apr 13 17:52:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance destroyed successfully.
Apr 13 17:52:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Attempting rescue
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 17:52:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Creating image(s)
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue" returned: 0 in 0.054s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start _get_guest_xml network_info=[{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:c7:81:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'numa_topology' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1565904434',display_name='tempest-ServerRescueNegativeTestJSON-server-1565904434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1565904434',id=17,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-epyvaovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:22Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=42e6a724-a30a-49db-8e06-fd1da3e57c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:c7:81:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:c7:81:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:52:02 user nova-compute[71354]:   <uuid>42e6a724-a30a-49db-8e06-fd1da3e57c6f</uuid>
Apr 13 17:52:02 user nova-compute[71354]:   <name>instance-00000011</name>
Apr 13 17:52:02 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:52:02 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:52:02 user nova-compute[71354]:   <metadata>
Apr 13 17:52:02 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:52:02 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1565904434</nova:name>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:52:02</nova:creationTime>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:52:02 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:52:02 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:owner>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 17:52:02 user nova-compute[71354]:       </nova:owner>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:52:02 user nova-compute[71354]:       <nova:ports>
Apr 13 17:52:02 user nova-compute[71354]:         <nova:port uuid="1264cd6a-928d-4e98-808e-0911f5498d48">
Apr 13 17:52:02 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 17:52:02 user nova-compute[71354]:         </nova:port>
Apr 13 17:52:02 user nova-compute[71354]:       </nova:ports>
Apr 13 17:52:02 user nova-compute[71354]:     </nova:instance>
Apr 13 17:52:02 user nova-compute[71354]:   </metadata>
Apr 13 17:52:02 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:52:02 user nova-compute[71354]:     <system>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="serial">42e6a724-a30a-49db-8e06-fd1da3e57c6f</entry>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="uuid">42e6a724-a30a-49db-8e06-fd1da3e57c6f</entry>
Apr 13 17:52:02 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:52:02 user nova-compute[71354]:     </system>
Apr 13 17:52:02 user nova-compute[71354]:   </sysinfo>
Apr 13 17:52:02 user nova-compute[71354]:   <os>
Apr 13 17:52:02 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:52:02 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:52:02 user nova-compute[71354]:   </os>
Apr 13 17:52:02 user nova-compute[71354]:   <features>
Apr 13 17:52:02 user nova-compute[71354]:     <acpi/>
Apr 13 17:52:02 user nova-compute[71354]:     <apic/>
Apr 13 17:52:02 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:52:02 user nova-compute[71354]:   </features>
Apr 13 17:52:02 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:52:02 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:52:02 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:52:02 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:52:02 user nova-compute[71354]:   </clock>
Apr 13 17:52:02 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:52:02 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:52:02 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:52:02 user nova-compute[71354]:   </cpu>
Apr 13 17:52:02 user nova-compute[71354]:   <devices>
Apr 13 17:52:02 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:52:02 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:52:02 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue"/>
Apr 13 17:52:02 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:52:02 user nova-compute[71354]:     </disk>
Apr 13 17:52:02 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:52:02 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:52:02 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk"/>
Apr 13 17:52:02 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:52:02 user nova-compute[71354]:     </disk>
Apr 13 17:52:02 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:52:02 user nova-compute[71354]:       <mac address="fa:16:3e:c7:81:72"/>
Apr 13 17:52:02 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:02 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:52:02 user nova-compute[71354]:       <target dev="tap1264cd6a-92"/>
Apr 13 17:52:02 user nova-compute[71354]:     </interface>
Apr 13 17:52:02 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:52:02 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/console.log" append="off"/>
Apr 13 17:52:02 user nova-compute[71354]:     </serial>
Apr 13 17:52:02 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:52:02 user nova-compute[71354]:     <video>
Apr 13 17:52:02 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:02 user nova-compute[71354]:     </video>
Apr 13 17:52:02 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:52:02 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:52:02 user nova-compute[71354]:     </rng>
Apr 13 17:52:02 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:52:02 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:52:02 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:52:02 user nova-compute[71354]:     </memballoon>
Apr 13 17:52:02 user nova-compute[71354]:   </devices>
Apr 13 17:52:02 user nova-compute[71354]: </domain>
Apr 13 17:52:02 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:52:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance destroyed successfully.
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:52:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:c7:81:72, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:52:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing instance network info cache due to event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:52:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:04 user nova-compute[71354]: WARNING nova.compute.manager [req-ee4c4fe8-fb4f-4d52-8a7f-0d879a003740 req-42dd3299-9ccd-4c0d-980c-0febf8c5acf1 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state active and task_state rescuing.
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updated VIF entry in instance network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing instance network info cache due to event network-changed-29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquiring lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquired lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Refreshing network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updated VIF entry in instance network info cache for port 29f94d48-0d45-4fe8-b310-e02fb491f42f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [{"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Releasing lock "refresh_cache-69605608-790d-49be-ab18-277549242bef" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:05 user nova-compute[71354]: WARNING nova.compute.manager [req-0b496f86-d72c-46e4-89fe-cb5c77d0a01f req-38a51f3c-4adf-4a60-8c8c-ec306d3ff353 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:05 user nova-compute[71354]: WARNING nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:05 user nova-compute[71354]: WARNING nova.compute.manager [req-17ef56da-abdc-48b1-b046-1dc79d8286e7 req-ea1d89f2-ddba-402f-b080-74a2d887ee35 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:52:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:06 user nova-compute[71354]: WARNING nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state active and task_state rescuing.
Apr 13 17:52:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:06 user nova-compute[71354]: WARNING nova.compute.manager [req-02cfd8d9-a881-43d9-9680-03f81fb84725 req-89285aa4-4419-4fbd-88fd-ad3f712d4aa5 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state active and task_state rescuing.
Apr 13 17:52:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Terminating instance
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 69605608-790d-49be-ab18-277549242bef due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408327.5926363, 69605608-790d-49be-ab18-277549242bef => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Resumed (Lifecycle Event)
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e2259efe-a19f-43da-8b99-6894ae973dc0 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0765c3dd-889e-40d5-ae25-2cfcf7c485c5 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 42e6a724-a30a-49db-8e06-fd1da3e57c6f due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408327.592883, 42e6a724-a30a-49db-8e06-fd1da3e57c6f => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] VM Resumed (Lifecycle Event)
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408327.5938535, 69605608-790d-49be-ab18-277549242bef => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] VM Started (Lifecycle Event)
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 69605608-790d-49be-ab18-277549242bef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408327.6082485, 42e6a724-a30a-49db-8e06-fd1da3e57c6f => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:07 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] VM Started (Lifecycle Event)
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-unplugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] No waiting events found dispatching network-vif-unplugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-unplugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Acquiring lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] No waiting events found dispatching network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:08 user nova-compute[71354]: WARNING nova.compute.manager [req-9d31c803-207f-4428-a91c-cfbd826eb911 req-b38b69eb-d10c-4119-8e9b-33515b864cba service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received unexpected event network-vif-plugged-965ec80e-f2ad-4833-b6e7-bd8c13e3973c for instance with vm_state active and task_state deleting.
Apr 13 17:52:08 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Instance destroyed successfully.
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.objects.instance [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lazy-loading 'resources' on Instance uuid 85f8857e-9e9b-4a5a-912a-4d79014417d0 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-394613299',display_name='tempest-VolumesAdminNegativeTest-server-394613299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-394613299',id=6,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNL/l3knLiGldwyflv/CZJe/UzD7tOPLEZPBkP18IAdcrOMkyDnl46cyo3jZSIFKOsS8+fVwmaiY3fk0liB5b07xzaHFCyr8+LNzfg1+EXTpq2CFfBk1qtKS/qY8fmuYw==',key_name='tempest-keypair-1911294089',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d6ea575d2574fcc99712adece6db415',ramdisk_id='',reservation_id='r-jc6lvtt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1540143869',owner_user_name='tempest-VolumesAdminNegativeTest-1540143869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d77fa5340ce44099224f2f161af5ecc',uuid=85f8857e-9e9b-4a5a-912a-4d79014417d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converting VIF {"id": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "address": "fa:16:3e:d2:a0:af", "network": {"id": "78f8d90f-b42e-43ff-8216-42798f0b8a43", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-757902035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6ea575d2574fcc99712adece6db415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965ec80e-f2", "ovs_interfaceid": "965ec80e-f2ad-4833-b6e7-bd8c13e3973c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG os_vif [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap965ec80e-f2, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:08 user nova-compute[71354]: INFO os_vif [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:a0:af,bridge_name='br-int',has_traffic_filtering=True,id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c,network=Network(78f8d90f-b42e-43ff-8216-42798f0b8a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965ec80e-f2')
Apr 13 17:52:08 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Deleting instance files /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0_del
Apr 13 17:52:08 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Deletion of /opt/stack/data/nova/instances/85f8857e-9e9b-4a5a-912a-4d79014417d0_del complete
Apr 13 17:52:08 user nova-compute[71354]: INFO nova.compute.manager [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 17:52:08 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:52:08 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:08 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Took 0.83 seconds to deallocate network for instance.
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Received event network-vif-deleted-965ec80e-f2ad-4833-b6e7-bd8c13e3973c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:09 user nova-compute[71354]: INFO nova.compute.manager [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Neutron deleted interface 965ec80e-f2ad-4833-b6e7-bd8c13e3973c; detaching it from the instance and deleting it from the info cache
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.network.neutron [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-fbb8a8ad-e540-4c3a-b6b0-ab3fcca3cbb8 req-474c3ede-3307-430a-8288-0c01dd85bafd service nova] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Detach interface failed, port_id=965ec80e-f2ad-4833-b6e7-bd8c13e3973c, reason: Instance 85f8857e-9e9b-4a5a-912a-4d79014417d0 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:52:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.940s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:10 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Deleted allocations for instance 85f8857e-9e9b-4a5a-912a-4d79014417d0
Apr 13 17:52:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-076cadd4-3523-480b-b426-5c4b92963d77 tempest-VolumesAdminNegativeTest-1540143869 tempest-VolumesAdminNegativeTest-1540143869-project-member] Lock "85f8857e-9e9b-4a5a-912a-4d79014417d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-changed-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing instance network info cache due to event network-changed-72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:52:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing network info cache for port 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:52:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updated VIF entry in instance network info cache for port 72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:52:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a812507c-51bd-4110-8b41-de7666772115 req-e46ff018-ea57-48a9-9b21-4750f3a1a6a8 service nova] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:14 user nova-compute[71354]: INFO nova.compute.manager [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Shelving
Apr 13 17:52:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:14 user nova-compute[71354]: WARNING nova.compute.manager [req-7f038f70-8c95-4820-97ed-5c6fb17e34d8 req-e26d72d0-255b-42db-ad00-63aa8dcf271f service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state active and task_state shelving.
Apr 13 17:52:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance destroyed successfully.
Apr 13 17:52:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Beginning cold snapshot process
Apr 13 17:52:15 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:52:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk /opt/stack/data/nova/instances/snapshots/tmpryho8pdt/58d15c29a8764d7ab898ce999abda673 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk /opt/stack/data/nova/instances/snapshots/tmpryho8pdt/58d15c29a8764d7ab898ce999abda673" returned: 0 in 0.396s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Snapshot extracted, beginning image upload
Apr 13 17:52:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:16 user nova-compute[71354]: WARNING nova.compute.manager [req-2eddffa8-13c9-43e0-afa2-11242a35f770 req-902fd418-b0d7-46e4-8edf-c64b91781dc3 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 17:52:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Snapshot image upload complete
Apr 13 17:52:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:17 user nova-compute[71354]: INFO nova.compute.manager [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Shelve offloading
Apr 13 17:52:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance destroyed successfully.
Apr 13 17:52:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance destroyed successfully.
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'resources' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqZOy7olKGfFEjGGEPUTWiwXJI6g8Pqj8VfYP7qUXA0qO+ggL6RxnieeiumVfVpIKABKlrT7FLRvV7y281BJMwrmjY6lnjk387cGRy7pkcY03EjqW+oukCEfTzjIpGsQ==',key_name='tempest-keypair-142800183',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:52:17.637427',shelved_host='user',shelved_image_id='79730d5c-e1b4-45e4-8af6-6c1ce16e1154'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG os_vif [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72193ca5-01, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-changed-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing instance network info cache due to event network-changed-72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG nova.network.neutron [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing network info cache for port 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:52:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:18 user nova-compute[71354]: INFO os_vif [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01')
Apr 13 17:52:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Deleting instance files /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa_del
Apr 13 17:52:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Deletion of /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa_del complete
Apr 13 17:52:19 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Deleted allocations for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa
Apr 13 17:52:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'numa_topology' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG nova.network.neutron [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updated VIF entry in instance network info cache for port 72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG nova.network.neutron [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap72193ca5-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-75935a5d-551d-4b1e-8b49-dbf964553600 req-85ebfc00-bb19-4bf5-ba5a-d3b9c4c8b99d service nova] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9320b036-00c0-4bd7-a73e-cbb5b5862d56 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.335s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:23 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408328.0284324, 85f8857e-9e9b-4a5a-912a-4d79014417d0 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:23 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] VM Stopped (Lifecycle Event)
Apr 13 17:52:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0332b5d3-741e-466d-859e-2220d57359c0 None None] [instance: 85f8857e-9e9b-4a5a-912a-4d79014417d0] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:29 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408334.91291, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:29 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Stopped (Lifecycle Event)
Apr 13 17:52:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-55c7ceb7-69e6-4286-b6a8-a0a7dd17ad2b None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:30 user nova-compute[71354]: INFO nova.compute.manager [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Terminating instance
Apr 13 17:52:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-83f4e071-7c5d-447c-a28f-49c0c63e0ab0 req-a0b00054-340e-4bed-b518-d1c9214c9de7 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-unplugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:52:30 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Instance destroyed successfully.
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'resources' on Instance uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid bc89ac54-6844-45b9-8dac-c10d893b699b {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 832e4b85-2c48-469d-a21e-c56cccfcabe4 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-652760998',display_name='tempest-TestMinimumBasicScenario-server-652760998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-652760998',id=11,image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/2PIs0BfFialBDNocPazDA/7rcCSlekPCMClQWyTEMb6n1ciIKA+7x1YWnMu59VjBTN1RxVDL9czLGIimP/yS7uC1ovBjrwoBUhVDzxZnPetW7Zt6HOn50CCv1S+GDTg==',key_name='tempest-TestMinimumBasicScenario-1346102396',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-9ftbg22b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f74a8be6-03b3-48d9-81ef-7d62c11ef0e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:49:55Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=832e4b85-2c48-469d-a21e-c56cccfcabe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "address": "fa:16:3e:d3:be:f6", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1fde03-37", "ovs_interfaceid": "7c1fde03-37b1-418b-8a56-9d046c05a1e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG os_vif [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c1fde03-37, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:31 user nova-compute[71354]: INFO os_vif [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:be:f6,bridge_name='br-int',has_traffic_filtering=True,id=7c1fde03-37b1-418b-8a56-9d046c05a1e0,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1fde03-37')
Apr 13 17:52:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Deleting instance files /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4_del
Apr 13 17:52:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Deletion of /opt/stack/data/nova/instances/832e4b85-2c48-469d-a21e-c56cccfcabe4_del complete
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.208s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.214s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.214s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:31 user nova-compute[71354]: INFO nova.compute.manager [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 13 17:52:31 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:52:31 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:32 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Took 0.57 seconds to deallocate network for instance.
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-deleted-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:32 user nova-compute[71354]: INFO nova.compute.manager [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Neutron deleted interface 7c1fde03-37b1-418b-8a56-9d046c05a1e0; detaching it from the instance and deleting it from the info cache
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-9a370fd5-c903-4a28-b97c-6beea3ad8dfa req-951644ee-734c-4f66-9772-c9a6d2b4846f service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Detach interface failed, port_id=7c1fde03-37b1-418b-8a56-9d046c05a1e0, reason: Instance 832e4b85-2c48-469d-a21e-c56cccfcabe4 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:32 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Deleted allocations for instance 832e4b85-2c48-469d-a21e-c56cccfcabe4
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bc77097e-eda1-4dbc-9485-051535076714 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.365s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:32 user nova-compute[71354]: INFO nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Acquiring lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] Lock "832e4b85-2c48-469d-a21e-c56cccfcabe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] No waiting events found dispatching network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:32 user nova-compute[71354]: WARNING nova.compute.manager [req-6e58a451-b73c-4bf2-bc5f-c1f0b05f0712 req-a014762d-d416-4ba7-bee5-71857df71737 service nova] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Received unexpected event network-vif-plugged-7c1fde03-37b1-418b-8a56-9d046c05a1e0 for instance with vm_state deleted and task_state None.
Apr 13 17:52:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:33 user nova-compute[71354]: INFO nova.compute.manager [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Detaching volume 8ecd92a2-3a8e-4592-ab17-08f7c384c450
Apr 13 17:52:34 user nova-compute[71354]: INFO nova.virt.block_device [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Attempting to driver detach volume 8ecd92a2-3a8e-4592-ab17-08f7c384c450 from mountpoint /dev/vdb
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Attempting to detach device vdb from instance 69605608-790d-49be-ab18-277549242bef from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:52:34 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:34 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:52:34 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:52:34 user nova-compute[71354]:   <serial>8ecd92a2-3a8e-4592-ab17-08f7c384c450</serial>
Apr 13 17:52:34 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:52:34 user nova-compute[71354]: </disk>
Apr 13 17:52:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:52:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Successfully detached device vdb from instance 69605608-790d-49be-ab18-277549242bef from the persistent domain config.
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69605608-790d-49be-ab18-277549242bef from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:52:34 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:34 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:52:34 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:52:34 user nova-compute[71354]:   <serial>8ecd92a2-3a8e-4592-ab17-08f7c384c450</serial>
Apr 13 17:52:34 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:52:34 user nova-compute[71354]: </disk>
Apr 13 17:52:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408354.4364092, 69605608-790d-49be-ab18-277549242bef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69605608-790d-49be-ab18-277549242bef {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:52:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Successfully detached device vdb from instance 69605608-790d-49be-ab18-277549242bef from the live domain config.
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUCBlEJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d252d-bdd4-4269-9022-41d6054c92e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:52:34 user nova-compute[71354]: No targets found.
Apr 13 17:52:34 user nova-compute[71354]: iSNS:
Apr 13 17:52:34 user nova-compute[71354]: No targets found.
Apr 13 17:52:34 user nova-compute[71354]: STATIC:
Apr 13 17:52:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:52:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:52:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450
Apr 13 17:52:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:52:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:34 user nova-compute[71354]: FIRMWARE:
Apr 13 17:52:34 user nova-compute[71354]: No targets found.
Apr 13 17:52:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:52:34 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:52:34 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5854565b-e113-4918-824b-4ad355209f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f04f46-2ce1-4b19-9def-576336ff30b3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da764280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4423ccd-f36e-47b3-9d79-2e3dae3604c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58acf1b2-681f-46ae-aa0e-5fb7144ba0d7]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dd558b-b603-4c5c-adbd-8dd637d388f4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d88ca1-6110-4c87-a835-1abaa11e1641]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ae7c83-c896-489f-ac29-325f79b6f6c4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865cd3b-b309-4f5e-814c-dacf710d49ef]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260]
Apr 13 17:52:34 user nova-compute[71354]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450, portal: 172.16.0.220,3260] successful.
Apr 13 17:52:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecd92a2-3a8e-4592-ab17-08f7c384c450 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d41649e-1db0-4f34-aae0-72e0bbb44633]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] <== disconnect_volume: return (291ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:52:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'flavor' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-51b0bd93-cc8e-4188-808a-615b439ad160 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:52:39 user nova-compute[71354]: INFO nova.compute.claims [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Claim successful on node user
Apr 13 17:52:39 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:52:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:52:40 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:52:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:52:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:52:40 user nova-compute[71354]: INFO nova.virt.block_device [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Booting with blank volume at /dev/vda
Apr 13 17:52:40 user nova-compute[71354]: DEBUG nova.policy [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:52:40 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Successfully created port: 9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Successfully updated port: 9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-changed-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Refreshing instance network info cache due to event network-changed-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance network_info: |[{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Refreshing network info cache for port 9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updated VIF entry in instance network info cache for port 9fdd1b17-9f90-475f-b0a0-17ddea2c8c96. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5c74175f-f7df-4c55-9808-8cea0c19e397 req-af18b83e-ec09-42b0-92a6-c95df8619e68 service nova] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.utils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2dcea5-244b-48eb-bb99-b5f6e66ccbd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236a8bb-fd1e-4ea8-950a-f8fc755027b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[26608cc0-4fab-45aa-a5d3-73d3872f65c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc4d2e-a538-4b87-8970-484d8c375220]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:52:45 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:52:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4aacb-f61f-42fa-9b99-5ea455b8ded7]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG os_brick.utils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:45 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating existing volume attachment record: 3fdcfe74-d773-4fde-925c-54bdbf76e027 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:52:46 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408351.2341132, 832e4b85-2c48-469d-a21e-c56cccfcabe4 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:46 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] VM Stopped (Lifecycle Event)
Apr 13 17:52:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3ba051e6-5678-4e58-b044-1c2251ba6b9d None None] [instance: 832e4b85-2c48-469d-a21e-c56cccfcabe4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:47 user nova-compute[71354]: INFO nova.compute.manager [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Detaching volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:52:47 user nova-compute[71354]: INFO nova.virt.block_device [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attempting to driver detach volume 5c44732c-d2f2-4383-895a-8ac2aeddeff9 from mountpoint /dev/vdb
Apr 13 17:52:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Attempting to detach device vdb from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:52:47 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:47 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:52:47 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:52:47 user nova-compute[71354]:   <serial>5c44732c-d2f2-4383-895a-8ac2aeddeff9</serial>
Apr 13 17:52:47 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:52:47 user nova-compute[71354]: </disk>
Apr 13 17:52:47 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:52:47 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully detached device vdb from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the persistent domain config.
Apr 13 17:52:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:52:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:52:47 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:47 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:52:47 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:52:47 user nova-compute[71354]:   <serial>5c44732c-d2f2-4383-895a-8ac2aeddeff9</serial>
Apr 13 17:52:47 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:52:47 user nova-compute[71354]: </disk>
Apr 13 17:52:47 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408368.079898, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:52:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully detached device vdb from instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 from the live domain config.
Apr 13 17:52:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMJtDRkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:48 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e74c9d-2003-466e-9bce-1043bd0b3a3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:52:48 user nova-compute[71354]: No targets found.
Apr 13 17:52:48 user nova-compute[71354]: iSNS:
Apr 13 17:52:48 user nova-compute[71354]: No targets found.
Apr 13 17:52:48 user nova-compute[71354]: STATIC:
Apr 13 17:52:48 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:52:48 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:48 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:48 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:52:48 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:48 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:48 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9
Apr 13 17:52:48 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:48 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:48 user nova-compute[71354]: FIRMWARE:
Apr 13 17:52:48 user nova-compute[71354]: No targets found.
Apr 13 17:52:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:52:48 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:52:48 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716f608-71bf-4a65-beaf-89d145d9e496]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf014e-c9c8-4e70-bed0-bc9e38ccc1be]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc321ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8ebc5-1555-40b4-9651-2beed7f6f82c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad7e4f-05ea-4d87-beef-091f5df2d222]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e3f8b-4899-4595-b328-469cd72e1ee3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[238095d0-fbf3-42a2-b31d-74419db2c3a9]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a19e09-3e43-4953-b6f2-77f160a483e1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db0ea4-28cd-489c-b796-b8d07ed35e58]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260]
Apr 13 17:52:48 user nova-compute[71354]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9, portal: 172.16.0.220,3260] successful.
Apr 13 17:52:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c44732c-d2f2-4383-895a-8ac2aeddeff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a1864-b5e0-471a-b17f-87ca03f2c9a0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (309ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'flavor' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c84a888-0a16-46b9-9086-b7b81a72bab9 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:52:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:52:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Creating image(s)
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Ensure instance console log exists: /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start _get_guest_xml network_info=[{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '3fdcfe74-d773-4fde-925c-54bdbf76e027', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1774abdc-69cc-4755-b62a-c74bc1997944', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'serial': 'ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:50 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:50 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:50 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1757187-58e9-43d2-addb-a9ef7c31e77e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:52:50 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219f623-d817-4cf6-9f3a-b1905f596286]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7] added
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c3da0-a321-4f49-9ae2-7f241109e256]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[19653870-8fec-4468-8d4e-06fb7ef3b3e9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIzcOmiY {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIzcOmiY" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7dac7-5a49-4d53-8007-5e5165b0107e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIzcOmiY'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1908e4b3-0b04-41f1-b828-d60b465469dc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa71a8-431d-4448-a4da-cd6e8897a166]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899ea0b-5b23-4aa3-ace5-dfafaa4b3f45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260]
Apr 13 17:52:50 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260] successful.
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a643cc-7c54-4a0c-af22-195f88e5900c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ecf872-c602-4682-bba4-15a7c98a56f6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703556a-879f-4761-8f21-89b51b011228]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7829MB free_disk=26.29131317138672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 69605608-790d-49be-ab18-277549242bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26465346532666234', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465346532666234', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-711902791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-711902791',id=20,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-msvxrede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:52:40Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=1774abdc-69cc-4755-b62a-c74bc1997944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:52:51 user nova-compute[71354]:   <uuid>1774abdc-69cc-4755-b62a-c74bc1997944</uuid>
Apr 13 17:52:51 user nova-compute[71354]:   <name>instance-00000014</name>
Apr 13 17:52:51 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:52:51 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:52:51 user nova-compute[71354]:   <metadata>
Apr 13 17:52:51 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:52:51 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-711902791</nova:name>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:52:50</nova:creationTime>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:52:51 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:52:51 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:owner>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 17:52:51 user nova-compute[71354]:       </nova:owner>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:52:51 user nova-compute[71354]:       <nova:ports>
Apr 13 17:52:51 user nova-compute[71354]:         <nova:port uuid="9fdd1b17-9f90-475f-b0a0-17ddea2c8c96">
Apr 13 17:52:51 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:52:51 user nova-compute[71354]:         </nova:port>
Apr 13 17:52:51 user nova-compute[71354]:       </nova:ports>
Apr 13 17:52:51 user nova-compute[71354]:     </nova:instance>
Apr 13 17:52:51 user nova-compute[71354]:   </metadata>
Apr 13 17:52:51 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:52:51 user nova-compute[71354]:     <system>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="serial">1774abdc-69cc-4755-b62a-c74bc1997944</entry>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="uuid">1774abdc-69cc-4755-b62a-c74bc1997944</entry>
Apr 13 17:52:51 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:52:51 user nova-compute[71354]:     </system>
Apr 13 17:52:51 user nova-compute[71354]:   </sysinfo>
Apr 13 17:52:51 user nova-compute[71354]:   <os>
Apr 13 17:52:51 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:52:51 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:52:51 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:52:51 user nova-compute[71354]:   </os>
Apr 13 17:52:51 user nova-compute[71354]:   <features>
Apr 13 17:52:51 user nova-compute[71354]:     <acpi/>
Apr 13 17:52:51 user nova-compute[71354]:     <apic/>
Apr 13 17:52:51 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:52:51 user nova-compute[71354]:   </features>
Apr 13 17:52:51 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:52:51 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:52:51 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:52:51 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:52:51 user nova-compute[71354]:   </clock>
Apr 13 17:52:51 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:52:51 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:52:51 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:52:51 user nova-compute[71354]:   </cpu>
Apr 13 17:52:51 user nova-compute[71354]:   <devices>
Apr 13 17:52:51 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:52:51 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:51 user nova-compute[71354]:       <source dev="/dev/sdb"/>
Apr 13 17:52:51 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:52:51 user nova-compute[71354]:       <serial>ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7</serial>
Apr 13 17:52:51 user nova-compute[71354]:     </disk>
Apr 13 17:52:51 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:52:51 user nova-compute[71354]:       <mac address="fa:16:3e:29:99:e5"/>
Apr 13 17:52:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:51 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:52:51 user nova-compute[71354]:       <target dev="tap9fdd1b17-9f"/>
Apr 13 17:52:51 user nova-compute[71354]:     </interface>
Apr 13 17:52:51 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:52:51 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/console.log" append="off"/>
Apr 13 17:52:51 user nova-compute[71354]:     </serial>
Apr 13 17:52:51 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:52:51 user nova-compute[71354]:     <video>
Apr 13 17:52:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:51 user nova-compute[71354]:     </video>
Apr 13 17:52:51 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:52:51 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:52:51 user nova-compute[71354]:     </rng>
Apr 13 17:52:51 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:52:51 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:52:51 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:52:51 user nova-compute[71354]:     </memballoon>
Apr 13 17:52:51 user nova-compute[71354]:   </devices>
Apr 13 17:52:51 user nova-compute[71354]: </domain>
Apr 13 17:52:51 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-711902791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-711902791',id=20,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-msvxrede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:52:40Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=1774abdc-69cc-4755-b62a-c74bc1997944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG os_vif [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fdd1b17-9f, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fdd1b17-9f, col_values=(('external_ids', {'iface-id': '9fdd1b17-9f90-475f-b0a0-17ddea2c8c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:99:e5', 'vm-uuid': '1774abdc-69cc-4755-b62a-c74bc1997944'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:51 user nova-compute[71354]: INFO os_vif [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f')
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:52:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:29:99:e5, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:52:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:53 user nova-compute[71354]: WARNING nova.compute.manager [req-04e2d7d6-213e-466a-ba7f-3c90b9bd0322 req-c1465c87-66eb-459a-aa1f-74aec3a4f3a9 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state building and task_state spawning.
Apr 13 17:52:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Skipping network cache update for instance because it is Building. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:52:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid bc89ac54-6844-45b9-8dac-c10d893b699b {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [{"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-bc89ac54-6844-45b9-8dac-c10d893b699b" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:52:54 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408375.2293992, 1774abdc-69cc-4755-b62a-c74bc1997944 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Resumed (Lifecycle Event)
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance spawned successfully.
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408375.2334204, 1774abdc-69cc-4755-b62a-c74bc1997944 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Started (Lifecycle Event)
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:52:55 user nova-compute[71354]: INFO nova.compute.manager [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Took 15.83 seconds to build instance.
Apr 13 17:52:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b4c1dc60-2b74-4856-9430-1743fea780e5 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.936s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:52:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:52:55 user nova-compute[71354]: WARNING nova.compute.manager [req-37f7b42f-a277-474b-a94f-d8cb22dad3ab req-6d36d889-73c7-44f2-acc4-bbdd6a764220 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state None.
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'info_cache' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:52:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance destroyed successfully.
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'resources' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap723c0bf0-b7, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:56 user nova-compute[71354]: INFO os_vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:52:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:56 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f4845-c332-43b6-b34b-91aa318b99e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:52:56 user nova-compute[71354]: No targets found.
Apr 13 17:52:56 user nova-compute[71354]: iSNS:
Apr 13 17:52:56 user nova-compute[71354]: No targets found.
Apr 13 17:52:56 user nova-compute[71354]: STATIC:
Apr 13 17:52:56 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:52:56 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:56 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:56 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:52:56 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:56 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:56 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:52:56 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:52:56 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:52:56 user nova-compute[71354]: FIRMWARE:
Apr 13 17:52:56 user nova-compute[71354]: No targets found.
Apr 13 17:52:56 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:52:56 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:52:56 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b5b0e-23bd-4a00-b7de-fb7711acb7ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba924d-08d1-4014-acb2-d3ad49e8ed50]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:56 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d4653010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[158a0028-1ef1-4ee4-8fc4-abb6e6bd006d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2177e-cd50-43fc-a7ae-11638c110cc1]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[00348405-4c18-432a-92c6-807e5e3bfff5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80b8bc-101e-4265-91a0-eb1ca840512e]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c306a0-8f49-4dda-a4c5-ab7f4e954eab]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbde0dd-c56a-464a-b2ac-62d8cc690f33]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]
Apr 13 17:52:57 user nova-compute[71354]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3823f064-9f33-4c47-93af-87c2be0eeb17]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== disconnect_volume: return (323ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start _get_guest_xml network_info=[{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'edd6fc52-f563-4d3e-a480-adb4d999feba', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9', 'attached_at': '', 'detached_at': '', 'volume_id': '101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'serial': '101df4ac-9f5e-4960-85e3-ccb7dc4be985'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'numa_topology' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:57 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:57 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:52:57 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:57 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:52:57 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78cd549-8c7d-4b82-83a5-24e9c31fc7a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:52:57 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a348245-179f-4e6d-a5a4-1e7942ddc84b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985] added
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9a7b9-1d1e-4004-b192-4a17dc63c275]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972591e-40e8-48f6-97ac-e08a1c233e30]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvNZDMAy {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvNZDMAy" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca2510-e307-4c3e-85e8-1c660f8acda8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvNZDMAy'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed1f84d-2db1-4e81-9cea-10d5908564f3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125e596-a6b5-45ae-930a-ad065045ba58]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5148b5-5da9-4a93-8b72-6d1eb1c83210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]
Apr 13 17:52:57 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[211f4b13-e3c0-410b-8e86-53cc479285db]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98abb08-d310-4a43-8f3a-77a8465c6888]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:52:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2b34e-aece-40aa-a29b-5fb5ee24763f]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:52:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23933313138383830', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933313138383830', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'pci_devices' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:52:58 user nova-compute[71354]:   <uuid>bcfd107b-fef8-4acf-9a2c-1861aabacfe9</uuid>
Apr 13 17:52:58 user nova-compute[71354]:   <name>instance-0000000d</name>
Apr 13 17:52:58 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:52:58 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:52:58 user nova-compute[71354]:   <metadata>
Apr 13 17:52:58 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:52:58 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeTestJSON-server-1433621576</nova:name>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:52:57</nova:creationTime>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:52:58 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:52:58 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:owner>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:user uuid="91769944ac8048dbb1f418d232e670d3">tempest-AttachVolumeTestJSON-2087525588-project-member</nova:user>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:project uuid="5ee8ad9e1bc74eb9b9997f7706d3f096">tempest-AttachVolumeTestJSON-2087525588</nova:project>
Apr 13 17:52:58 user nova-compute[71354]:       </nova:owner>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:52:58 user nova-compute[71354]:       <nova:ports>
Apr 13 17:52:58 user nova-compute[71354]:         <nova:port uuid="723c0bf0-b727-4ff6-b9fe-2197b7609fa0">
Apr 13 17:52:58 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:52:58 user nova-compute[71354]:         </nova:port>
Apr 13 17:52:58 user nova-compute[71354]:       </nova:ports>
Apr 13 17:52:58 user nova-compute[71354]:     </nova:instance>
Apr 13 17:52:58 user nova-compute[71354]:   </metadata>
Apr 13 17:52:58 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:52:58 user nova-compute[71354]:     <system>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="serial">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="uuid">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:52:58 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:52:58 user nova-compute[71354]:     </system>
Apr 13 17:52:58 user nova-compute[71354]:   </sysinfo>
Apr 13 17:52:58 user nova-compute[71354]:   <os>
Apr 13 17:52:58 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:52:58 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:52:58 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:52:58 user nova-compute[71354]:   </os>
Apr 13 17:52:58 user nova-compute[71354]:   <features>
Apr 13 17:52:58 user nova-compute[71354]:     <acpi/>
Apr 13 17:52:58 user nova-compute[71354]:     <apic/>
Apr 13 17:52:58 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:52:58 user nova-compute[71354]:   </features>
Apr 13 17:52:58 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:52:58 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:52:58 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:52:58 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:52:58 user nova-compute[71354]:   </clock>
Apr 13 17:52:58 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:52:58 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:52:58 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:52:58 user nova-compute[71354]:   </cpu>
Apr 13 17:52:58 user nova-compute[71354]:   <devices>
Apr 13 17:52:58 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:52:58 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:52:58 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk"/>
Apr 13 17:52:58 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:52:58 user nova-compute[71354]:     </disk>
Apr 13 17:52:58 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:52:58 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:52:58 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 17:52:58 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:52:58 user nova-compute[71354]:       <serial>101df4ac-9f5e-4960-85e3-ccb7dc4be985</serial>
Apr 13 17:52:58 user nova-compute[71354]:     </disk>
Apr 13 17:52:58 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:52:58 user nova-compute[71354]:       <mac address="fa:16:3e:9b:e2:8a"/>
Apr 13 17:52:58 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:58 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:52:58 user nova-compute[71354]:       <target dev="tap723c0bf0-b7"/>
Apr 13 17:52:58 user nova-compute[71354]:     </interface>
Apr 13 17:52:58 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:52:58 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/console.log" append="off"/>
Apr 13 17:52:58 user nova-compute[71354]:     </serial>
Apr 13 17:52:58 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:52:58 user nova-compute[71354]:     <video>
Apr 13 17:52:58 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:52:58 user nova-compute[71354]:     </video>
Apr 13 17:52:58 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:52:58 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:52:58 user nova-compute[71354]:     </rng>
Apr 13 17:52:58 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:52:58 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:52:58 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:52:58 user nova-compute[71354]:     </memballoon>
Apr 13 17:52:58 user nova-compute[71354]:   </devices>
Apr 13 17:52:58 user nova-compute[71354]: </domain>
Apr 13 17:52:58 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Cannot resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.objects.instance [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'migration_context' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG os_vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap723c0bf0-b7, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap723c0bf0-b7, col_values=(('external_ids', {'iface-id': '723c0bf0-b727-4ff6-b9fe-2197b7609fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:e2:8a', 'vm-uuid': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:52:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:52:59 user nova-compute[71354]: INFO os_vif [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:53:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:00 user nova-compute[71354]: DEBUG nova.compute.manager [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:00 user nova-compute[71354]: WARNING nova.compute.manager [req-d5a7ca62-0b28-4769-b520-3514fd230073 req-922896e0-3dfd-45de-8f55-955449e48762 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state powering-on.
Apr 13 17:53:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408382.7635865, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:02 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Resumed (Lifecycle Event)
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:53:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance rebooted successfully.
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-59cca9d2-fb43-4313-a6af-f089aae594f8 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:02 user nova-compute[71354]: WARNING nova.compute.manager [req-f92fb0a7-6e77-47d1-818b-d6babae65a7c req-8db19aab-0a26-4736-9f86-01724c6d947e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state powering-on.
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:02 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408382.7650847, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:02 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Started (Lifecycle Event)
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing instance network info cache due to event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG nova.network.neutron [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:20 user nova-compute[71354]: INFO nova.compute.manager [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Shelve offloading
Apr 13 17:53:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updated VIF entry in instance network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5b073324-4ad7-439d-bbf5-44ba13b18d06 req-b972b6ce-95a7-4fef-af7c-7b00535c576b service nova] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance destroyed successfully.
Apr 13 17:53:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:22 user nova-compute[71354]: WARNING nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state active and task_state shelving.
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:22 user nova-compute[71354]: WARNING nova.compute.manager [req-7d1d7a58-aa10-4369-b214-8b5ab369d5a4 req-ce4c776c-4111-4aae-ba11-b21b56de7da2 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state active and task_state shelving.
Apr 13 17:53:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance destroyed successfully.
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'resources' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+7fvwpKiIT941SPCbdY9x4Jev0kmNw794zuyTRCpHksjAYtGwMPWm/1jEY16x/UTkRyA96KR24i+FrqltRAjlx3KlYCS1QyCMn13CUYjLuHW0Kxt41qWBnmQAfLfVj5A==',key_name='tempest-TestShelveInstance-822246976',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:51:40Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_vif [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8064fded-37, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:53:22 user nova-compute[71354]: INFO os_vif [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37')
Apr 13 17:53:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:53:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1561c77-17fd-4ca2-8acd-9087198cdd00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:53:22 user nova-compute[71354]: No targets found.
Apr 13 17:53:22 user nova-compute[71354]: iSNS:
Apr 13 17:53:22 user nova-compute[71354]: No targets found.
Apr 13 17:53:22 user nova-compute[71354]: STATIC:
Apr 13 17:53:22 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:53:22 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:53:22 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:53:22 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:53:22 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:53:22 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:53:22 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:53:22 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:53:22 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:53:22 user nova-compute[71354]: FIRMWARE:
Apr 13 17:53:22 user nova-compute[71354]: No targets found.
Apr 13 17:53:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:53:22 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:53:22 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc2adc-865b-4800-b9fd-14434eea7168]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b238537-aa2a-4a57-a446-77d4d921d4bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:53:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da785900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74552980-89ab-4b10-bf99-d58670bc91d2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84db1df9-5958-4f1f-99a4-07601c558166]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d24663-fd60-4437-8151-6026da8dc22a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[14722275-c789-4fcb-8bb6-eadf14dbe76b]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:53:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc89301-f815-4294-bdde-73f9a85bcdd9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97486081-268d-468c-892c-4412ba16b9df]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]
Apr 13 17:53:23 user nova-compute[71354]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.
Apr 13 17:53:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f523b69-16db-4632-9ea9-5521952cbc46]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== disconnect_volume: return (320ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:53:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:53:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deleting instance files /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8_del
Apr 13 17:53:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deletion of /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8_del complete
Apr 13 17:53:24 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Deleted allocations for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'numa_topology' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing instance network info cache due to event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ee04ee33-50f3-4f65-8c89-d601b0b602d0 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.781s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:53:24 user nova-compute[71354]: INFO nova.compute.claims [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Claim successful on node user
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updated VIF entry in instance network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": null, "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8064fded-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bda4a7d9-373d-42e9-9dde-794ccd48c8f7 req-21f733a4-51f8-4a73-ab06-bd6f5f3129bb service nova] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.175s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:53:25 user nova-compute[71354]: INFO nova.compute.claims [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Claim successful on node user
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:53:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.policy [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bdac67b9cc149b4b802c96fc87fc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bc3754064947c89397db4a80161b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:53:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Creating image(s)
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "/opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "/opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "/opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.virt.images [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 28d6a612-1fe1-4e25-bad1-473206295a5a was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.part /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.061s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Successfully created port: c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.part /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.converted" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.062s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.policy [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:53:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Creating image(s)
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json" returned: 0 in 0.168s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:26 user nova-compute[71354]: INFO nova.compute.manager [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Terminating instance
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json" returned: 0 in 0.172s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f,backing_fmt=raw /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f,backing_fmt=raw /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk 1073741824" returned: 0 in 0.089s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "aa82955b54d88cc4ae8b09969406e4b2fcd73c4f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk 1073741824" returned: 0 in 0.093s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f --force-share --output=json" returned: 0 in 0.188s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.189s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Cannot resize image /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'migration_context' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Ensure instance console log exists: /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c794a7b9-8eac-4ed3-a787-d435af42ddcb req-71b635de-6f59-465e-8d85-bc4a75669ca2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-unplugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Cannot resize image /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'migration_context' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Ensure instance console log exists: /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Successfully updated port: c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing instance network info cache due to event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 69605608-790d-49be-ab18-277549242bef] Instance destroyed successfully.
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lazy-loading 'resources' on Instance uuid 69605608-790d-49be-ab18-277549242bef {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-547648089',display_name='tempest-ServerStableDeviceRescueTest-server-547648089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-547648089',id=5,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr+Qp1DpGYd28SffPEL0KXHEyGVeNEzd/4SaNj92SqYaC3oPsix558denqtUGb8CVqhKclqMvdjbWzCvn1ComQgDM/fgeBZ91Z9GAUCB0F7d60nu+OvCRg4Monp5Wob+A==',key_name='tempest-keypair-1772761791',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='984a0fd6f48449a7ba8f9944243580b9',ramdisk_id='',reservation_id='r-974o4k1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1535501044',owner_user_name='tempest-ServerStableDeviceRescueTest-1535501044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbea54954e534fdc933b94936a47a0b3',uuid=69605608-790d-49be-ab18-277549242bef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converting VIF {"id": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "address": "fa:16:3e:ae:a9:e8", "network": {"id": "27d613f4-b813-4f4f-90a9-924fab95dfda", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1771350908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "984a0fd6f48449a7ba8f9944243580b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f94d48-0d", "ovs_interfaceid": "29f94d48-0d45-4fe8-b310-e02fb491f42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG os_vif [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29f94d48-0d, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Successfully created port: 274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:53:27 user nova-compute[71354]: INFO os_vif [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a9:e8,bridge_name='br-int',has_traffic_filtering=True,id=29f94d48-0d45-4fe8-b310-e02fb491f42f,network=Network(27d613f4-b813-4f4f-90a9-924fab95dfda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f94d48-0d')
Apr 13 17:53:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Deleting instance files /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef_del
Apr 13 17:53:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Deletion of /opt/stack/data/nova/instances/69605608-790d-49be-ab18-277549242bef_del complete
Apr 13 17:53:27 user nova-compute[71354]: INFO nova.compute.manager [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] [instance: 69605608-790d-49be-ab18-277549242bef] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 13 17:53:27 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 69605608-790d-49be-ab18-277549242bef] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:53:27 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 69605608-790d-49be-ab18-277549242bef] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance network_info: |[{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Start _get_guest_xml network_info=[{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:53:22Z,direct_url=<?>,disk_format='qcow2',id=28d6a612-1fe1-4e25-bad1-473206295a5a,min_disk=0,min_ram=0,name='tempest-scenario-img--792775596',owner='88bc3754064947c89397db4a80161b3a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:53:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': '28d6a612-1fe1-4e25-bad1-473206295a5a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:53:28 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:28 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:53:22Z,direct_url=<?>,disk_format='qcow2',id=28d6a612-1fe1-4e25-bad1-473206295a5a,min_disk=0,min_ram=0,name='tempest-scenario-img--792775596',owner='88bc3754064947c89397db4a80161b3a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:53:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1896778579',display_name='tempest-TestMinimumBasicScenario-server-1896778579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1896778579',id=21,image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLysvbE0Zrt+5zeKxWLtNIm39mAiKNd+gGRtek5jM3u3q5+HDdY7ZVNT4gqmc4z9u+Zv3inGiNzJbMJwWIVELJjhr617KXuuTECL0R2iXXA0bPv4LE/O7ioJZYA/bq18fA==',key_name='tempest-TestMinimumBasicScenario-969682718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-7yi0b8ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:53:25Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=37a22063-cedb-45b0-8554-b1e60a7d4324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'pci_devices' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:53:28 user nova-compute[71354]:   <uuid>37a22063-cedb-45b0-8554-b1e60a7d4324</uuid>
Apr 13 17:53:28 user nova-compute[71354]:   <name>instance-00000015</name>
Apr 13 17:53:28 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:53:28 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:53:28 user nova-compute[71354]:   <metadata>
Apr 13 17:53:28 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:53:28 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:name>tempest-TestMinimumBasicScenario-server-1896778579</nova:name>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:53:28</nova:creationTime>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:53:28 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:53:28 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:owner>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:user uuid="8bdac67b9cc149b4b802c96fc87fc801">tempest-TestMinimumBasicScenario-1587858147-project-member</nova:user>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:project uuid="88bc3754064947c89397db4a80161b3a">tempest-TestMinimumBasicScenario-1587858147</nova:project>
Apr 13 17:53:28 user nova-compute[71354]:       </nova:owner>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:root type="image" uuid="28d6a612-1fe1-4e25-bad1-473206295a5a"/>
Apr 13 17:53:28 user nova-compute[71354]:       <nova:ports>
Apr 13 17:53:28 user nova-compute[71354]:         <nova:port uuid="c42e9982-60be-4b92-8ea1-460ff84f6a26">
Apr 13 17:53:28 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:53:28 user nova-compute[71354]:         </nova:port>
Apr 13 17:53:28 user nova-compute[71354]:       </nova:ports>
Apr 13 17:53:28 user nova-compute[71354]:     </nova:instance>
Apr 13 17:53:28 user nova-compute[71354]:   </metadata>
Apr 13 17:53:28 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:53:28 user nova-compute[71354]:     <system>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="serial">37a22063-cedb-45b0-8554-b1e60a7d4324</entry>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="uuid">37a22063-cedb-45b0-8554-b1e60a7d4324</entry>
Apr 13 17:53:28 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:53:28 user nova-compute[71354]:     </system>
Apr 13 17:53:28 user nova-compute[71354]:   </sysinfo>
Apr 13 17:53:28 user nova-compute[71354]:   <os>
Apr 13 17:53:28 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:53:28 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:53:28 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:53:28 user nova-compute[71354]:   </os>
Apr 13 17:53:28 user nova-compute[71354]:   <features>
Apr 13 17:53:28 user nova-compute[71354]:     <acpi/>
Apr 13 17:53:28 user nova-compute[71354]:     <apic/>
Apr 13 17:53:28 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:53:28 user nova-compute[71354]:   </features>
Apr 13 17:53:28 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:53:28 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:53:28 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:53:28 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:53:28 user nova-compute[71354]:   </clock>
Apr 13 17:53:28 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:53:28 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:53:28 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:53:28 user nova-compute[71354]:   </cpu>
Apr 13 17:53:28 user nova-compute[71354]:   <devices>
Apr 13 17:53:28 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:53:28 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:53:28 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk"/>
Apr 13 17:53:28 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:53:28 user nova-compute[71354]:     </disk>
Apr 13 17:53:28 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:53:28 user nova-compute[71354]:       <mac address="fa:16:3e:34:15:00"/>
Apr 13 17:53:28 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:53:28 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:53:28 user nova-compute[71354]:       <target dev="tapc42e9982-60"/>
Apr 13 17:53:28 user nova-compute[71354]:     </interface>
Apr 13 17:53:28 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:53:28 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/console.log" append="off"/>
Apr 13 17:53:28 user nova-compute[71354]:     </serial>
Apr 13 17:53:28 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:53:28 user nova-compute[71354]:     <video>
Apr 13 17:53:28 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:53:28 user nova-compute[71354]:     </video>
Apr 13 17:53:28 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:53:28 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:53:28 user nova-compute[71354]:     </rng>
Apr 13 17:53:28 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:53:28 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:53:28 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:53:28 user nova-compute[71354]:     </memballoon>
Apr 13 17:53:28 user nova-compute[71354]:   </devices>
Apr 13 17:53:28 user nova-compute[71354]: </domain>
Apr 13 17:53:28 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1896778579',display_name='tempest-TestMinimumBasicScenario-server-1896778579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1896778579',id=21,image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLysvbE0Zrt+5zeKxWLtNIm39mAiKNd+gGRtek5jM3u3q5+HDdY7ZVNT4gqmc4z9u+Zv3inGiNzJbMJwWIVELJjhr617KXuuTECL0R2iXXA0bPv4LE/O7ioJZYA/bq18fA==',key_name='tempest-TestMinimumBasicScenario-969682718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-7yi0b8ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:53:25Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=37a22063-cedb-45b0-8554-b1e60a7d4324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG os_vif [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc42e9982-60, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc42e9982-60, col_values=(('external_ids', {'iface-id': 'c42e9982-60be-4b92-8ea1-460ff84f6a26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:15:00', 'vm-uuid': '37a22063-cedb-45b0-8554-b1e60a7d4324'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:28 user nova-compute[71354]: INFO os_vif [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60')
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:53:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No VIF found with MAC fa:16:3e:34:15:00, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 69605608-790d-49be-ab18-277549242bef] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:29 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 69605608-790d-49be-ab18-277549242bef] Took 1.21 seconds to deallocate network for instance.
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updated VIF entry in instance network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-901a0d64-593b-4b81-85f1-3a8c73c5547d req-605ed629-220a-4a44-941d-a0be70d81870 service nova] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Successfully updated port: 274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Acquiring lock "69605608-790d-49be-ab18-277549242bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] Lock "69605608-790d-49be-ab18-277549242bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] No waiting events found dispatching network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:29 user nova-compute[71354]: WARNING nova.compute.manager [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received unexpected event network-vif-plugged-29f94d48-0d45-4fe8-b310-e02fb491f42f for instance with vm_state deleted and task_state None.
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-92b5eb72-ada9-4436-804a-b7c2bbab0358 req-ae99f88c-025a-42c3-b3aa-d62c324908d2 service nova] [instance: 69605608-790d-49be-ab18-277549242bef] Received event network-vif-deleted-29f94d48-0d45-4fe8-b310-e02fb491f42f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:29 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Deleted allocations for instance 69605608-790d-49be-ab18-277549242bef
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-767a2015-06e9-425b-abd0-9a5c9035c068 tempest-ServerStableDeviceRescueTest-1535501044 tempest-ServerStableDeviceRescueTest-1535501044-project-member] Lock "69605608-790d-49be-ab18-277549242bef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-changed-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing instance network info cache due to event network-changed-274ea36d-e1f3-418a-9afa-173db904ef77. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Instance network_info: |[{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing network info cache for port 274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Start _get_guest_xml network_info=[{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:53:29 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:29 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'pci_devices' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:53:29 user nova-compute[71354]:   <uuid>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</uuid>
Apr 13 17:53:29 user nova-compute[71354]:   <name>instance-00000016</name>
Apr 13 17:53:29 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:53:29 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:53:29 user nova-compute[71354]:   <metadata>
Apr 13 17:53:29 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:53:29 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:name>tempest-device-tagging-server-928673615</nova:name>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:53:29</nova:creationTime>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:53:29 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:53:29 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:owner>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:user uuid="c859ceec3df54c6ab1ae98a2c5320c2a">tempest-TaggedAttachmentsTest-1546533741-project-member</nova:user>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:project uuid="b120144ed4294837a716e156b12222e3">tempest-TaggedAttachmentsTest-1546533741</nova:project>
Apr 13 17:53:29 user nova-compute[71354]:       </nova:owner>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:53:29 user nova-compute[71354]:       <nova:ports>
Apr 13 17:53:29 user nova-compute[71354]:         <nova:port uuid="274ea36d-e1f3-418a-9afa-173db904ef77">
Apr 13 17:53:29 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:53:29 user nova-compute[71354]:         </nova:port>
Apr 13 17:53:29 user nova-compute[71354]:       </nova:ports>
Apr 13 17:53:29 user nova-compute[71354]:     </nova:instance>
Apr 13 17:53:29 user nova-compute[71354]:   </metadata>
Apr 13 17:53:29 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:53:29 user nova-compute[71354]:     <system>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="serial">d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="uuid">d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:53:29 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:53:29 user nova-compute[71354]:     </system>
Apr 13 17:53:29 user nova-compute[71354]:   </sysinfo>
Apr 13 17:53:29 user nova-compute[71354]:   <os>
Apr 13 17:53:29 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:53:29 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:53:29 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:53:29 user nova-compute[71354]:   </os>
Apr 13 17:53:29 user nova-compute[71354]:   <features>
Apr 13 17:53:29 user nova-compute[71354]:     <acpi/>
Apr 13 17:53:29 user nova-compute[71354]:     <apic/>
Apr 13 17:53:29 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:53:29 user nova-compute[71354]:   </features>
Apr 13 17:53:29 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:53:29 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:53:29 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:53:29 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:53:29 user nova-compute[71354]:   </clock>
Apr 13 17:53:29 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:53:29 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:53:29 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:53:29 user nova-compute[71354]:   </cpu>
Apr 13 17:53:29 user nova-compute[71354]:   <devices>
Apr 13 17:53:29 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:53:29 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:53:29 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk"/>
Apr 13 17:53:29 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:53:29 user nova-compute[71354]:     </disk>
Apr 13 17:53:29 user nova-compute[71354]:     <disk type="file" device="cdrom">
Apr 13 17:53:29 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 17:53:29 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config"/>
Apr 13 17:53:29 user nova-compute[71354]:       <target dev="hda" bus="ide"/>
Apr 13 17:53:29 user nova-compute[71354]:     </disk>
Apr 13 17:53:29 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:53:29 user nova-compute[71354]:       <mac address="fa:16:3e:2b:9c:29"/>
Apr 13 17:53:29 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:53:29 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:53:29 user nova-compute[71354]:       <target dev="tap274ea36d-e1"/>
Apr 13 17:53:29 user nova-compute[71354]:     </interface>
Apr 13 17:53:29 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:53:29 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log" append="off"/>
Apr 13 17:53:29 user nova-compute[71354]:     </serial>
Apr 13 17:53:29 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:53:29 user nova-compute[71354]:     <video>
Apr 13 17:53:29 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:53:29 user nova-compute[71354]:     </video>
Apr 13 17:53:29 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:53:29 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:53:29 user nova-compute[71354]:     </rng>
Apr 13 17:53:29 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:53:29 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:53:29 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:53:29 user nova-compute[71354]:     </memballoon>
Apr 13 17:53:29 user nova-compute[71354]:   </devices>
Apr 13 17:53:29 user nova-compute[71354]: </domain>
Apr 13 17:53:29 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG os_vif [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap274ea36d-e1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap274ea36d-e1, col_values=(('external_ids', {'iface-id': '274ea36d-e1f3-418a-9afa-173db904ef77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:9c:29', 'vm-uuid': 'd0042ccb-5c99-4880-8ec4-3a3c54769d6d'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: INFO os_vif [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1')
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name hda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No VIF found with MAC fa:16:3e:2b:9c:29, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:53:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Using config drive
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Creating config drive at /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpai3hg7q5 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpai3hg7q5" returned: 0 in 0.054s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:30 user nova-compute[71354]: WARNING nova.compute.manager [req-c76ba8aa-935a-4258-8bad-b1bf2ec17ec2 req-1d187e66-651b-4a02-a363-956e4297f76e service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state building and task_state spawning.
Apr 13 17:53:30 user nova-compute[71354]: DEBUG nova.network.neutron [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updated VIF entry in instance network info cache for port 274ea36d-e1f3-418a-9afa-173db904ef77. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG nova.network.neutron [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8fba4f9a-7058-4eb0-bee7-8e0716565b5f req-b5399c53-9e79-405e-9920-7b6b2c0081f1 service nova] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:32 user nova-compute[71354]: WARNING nova.compute.manager [req-da4e5d4d-f8da-42c9-80d8-12de741a0dbb req-cab0c9d7-61d1-4910-a214-ff508f90c8e8 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state building and task_state spawning.
Apr 13 17:53:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:32 user nova-compute[71354]: WARNING nova.compute.manager [req-70b759ea-de5b-4b62-9bc2-b9366d5428a2 req-77f02b96-b9da-48b9-8739-5a7ab15d2a84 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 for instance with vm_state building and task_state spawning.
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408413.6044443, 37a22063-cedb-45b0-8554-b1e60a7d4324 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] VM Resumed (Lifecycle Event)
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance spawned successfully.
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408413.6071754, 37a22063-cedb-45b0-8554-b1e60a7d4324 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] VM Started (Lifecycle Event)
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Took 8.24 seconds to spawn the instance on the hypervisor.
Apr 13 17:53:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:33 user nova-compute[71354]: INFO nova.compute.manager [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Took 9.06 seconds to build instance.
Apr 13 17:53:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fb4503df-8209-40ab-8b99-6d804492af85 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.165s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408414.3368526, d0042ccb-5c99-4880-8ec4-3a3c54769d6d => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] VM Resumed (Lifecycle Event)
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Instance spawned successfully.
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408414.3397834, d0042ccb-5c99-4880-8ec4-3a3c54769d6d => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] VM Started (Lifecycle Event)
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:53:34 user nova-compute[71354]: WARNING nova.compute.manager [req-505890f5-136c-47a0-be84-aa19f61c73bb req-c4b7089f-4a2a-4d80-92a7-af8db6a165e8 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 for instance with vm_state building and task_state spawning.
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Took 7.79 seconds to spawn the instance on the hypervisor.
Apr 13 17:53:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:34 user nova-compute[71354]: INFO nova.compute.manager [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Took 9.49 seconds to build instance.
Apr 13 17:53:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d6204d4-7e07-469a-b6e9-ff53340ae260 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.603s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:36 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408401.594545, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:36 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Stopped (Lifecycle Event)
Apr 13 17:53:36 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9d1127db-58c8-443c-b9e2-c27a990bc39f None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:42 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408407.8219678, 69605608-790d-49be-ab18-277549242bef => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:53:42 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 69605608-790d-49be-ab18-277549242bef] VM Stopped (Lifecycle Event)
Apr 13 17:53:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c2240b1d-7db4-481a-bfdf-2cc2a2cef923 None None] [instance: 69605608-790d-49be-ab18-277549242bef] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:53:43 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:44 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:53:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:53:53 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:53 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=26.312850952148438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bc89ac54-6844-45b9-8dac-c10d893b699b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:53:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:53:54 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:53:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:53:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:53:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:53:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:53:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:53:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:53:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:06 user nova-compute[71354]: INFO nova.compute.manager [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Unshelving
Apr 13 17:54:06 user nova-compute[71354]: INFO nova.virt.block_device [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Booting with volume 841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 at /dev/vdc
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.utils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64daf8a2-9584-41af-a76c-f964e7c79366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c717a581-8a3f-4015-86a3-0e8f028f0dd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce2617-21cc-4dc8-a7ae-a6558fc94238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[631749d1-c63b-4bd1-8207-4266d35bf07d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:06 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:54:06 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac0e0e-8fae-4f09-bc04-3fe537124d03]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG os_brick.utils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:06 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating existing volume attachment record: 716ab119-3e38-4f4c-a7d4-8076a757bade {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:54:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_requests' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'numa_topology' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:54:11 user nova-compute[71354]: INFO nova.compute.claims [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Claim successful on node user
Apr 13 17:54:11 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:54:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:11 user nova-compute[71354]: INFO nova.network.neutron [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating port 72193ca5-011d-4cf8-b016-194d83952281 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-changed-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing instance network info cache due to event network-changed-72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:54:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Acquiring lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:54:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Creating image(s)
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Acquired lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.network.neutron [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Refreshing network info cache for port 72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.virt.images [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 79730d5c-e1b4-45e4-8af6-6c1ce16e1154 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.part /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.part /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.converted" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.074s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updated VIF entry in instance network info cache for port 72193ca5-011d-4cf8-b016-194d83952281. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79ed1435-710f-4e73-bc5a-41766367dcb6 req-e7f84611-c5fd-44ad-a09c-339338ed77ac service nova] Releasing lock "refresh_cache-1753314b-bfd7-4e8b-986b-0253666ab8aa" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c,backing_fmt=raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c,backing_fmt=raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk 1073741824" returned: 0 in 0.051s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ab2d607f670d658af2f3cbf626cf70a8d787256c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'migration_context' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Rebasing disk image.
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 -F raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 -F raw /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk" returned: 0 in 2.065s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Ensure instance console log exists: /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start _get_guest_xml network_info=[{"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='003031b2a7cfdcc47a4671ee9e390f25',container_format='bare',created_at=2023-04-13T17:52:14Z,direct_url=<?>,disk_format='qcow2',id=79730d5c-e1b4-45e4-8af6-6c1ce16e1154,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1379597542-shelved',owner='c3589c01630f4f83a6925d97943c574b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T17:52:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '716ab119-3e38-4f4c-a7d4-8076a757bade', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMYLivXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1753314b-bfd7-4e8b-986b-0253666ab8aa', 'attached_at': '', 'detached_at': '', 'volume_id': '841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 'serial': '841bd7fe-de3a-41ad-b1c2-1e46cf6645e8'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:54:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='003031b2a7cfdcc47a4671ee9e390f25',container_format='bare',created_at=2023-04-13T17:52:14Z,direct_url=<?>,disk_format='qcow2',id=79730d5c-e1b4-45e4-8af6-6c1ce16e1154,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1379597542-shelved',owner='c3589c01630f4f83a6925d97943c574b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T17:52:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMYLivXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:16 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:16 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:16 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b199c060-2e97-4f6b-a382-3e6455cb1d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:54:16 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df3552-f093-43d1-b9d9-a98a1b376e18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8] added
Apr 13 17:54:16 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ae28a-9d7c-4999-b48f-cb96e798d29e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e3aa2a-9379-4094-83e1-715efa2a3817]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMYLivXg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMYLivXg" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cd551-b61e-4ccf-b1cc-de567ecac0aa]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMYLivXg'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65839269-37cc-488c-b7a4-422b5948e2e2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3358112-1573-427f-ba64-90dc8f6a5bc3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[92368972-c3f8-40f7-9f04-c8f387c4ee80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260]
Apr 13 17:54:17 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260] successful.
Apr 13 17:54:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430430c-fa0d-4ff0-b5c6-da84957384fe]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e55f52-4884-49bc-8dfa-232cf6bed024]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.041s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d83f5d0-8461-4b0c-aee6-8a6cc943d890]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:54:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMYLivXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23830303239626662', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830303239626662', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='79730d5c-e1b4-45e4-8af6-6c1ce16e1154',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-142800183',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:52:17.637427',shelved_host='user',shelved_image_id='79730d5c-e1b4-45e4-8af6-6c1ce16e1154'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_devices' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:54:18 user nova-compute[71354]:   <uuid>1753314b-bfd7-4e8b-986b-0253666ab8aa</uuid>
Apr 13 17:54:18 user nova-compute[71354]:   <name>instance-00000012</name>
Apr 13 17:54:18 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:54:18 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:54:18 user nova-compute[71354]:   <metadata>
Apr 13 17:54:18 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:54:18 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1379597542</nova:name>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:54:16</nova:creationTime>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:54:18 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:54:18 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:owner>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:user uuid="6be9926ecd1d45d89aba2e65ac3e0bfc">tempest-AttachVolumeShelveTestJSON-1896381340-project-member</nova:user>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:project uuid="c3589c01630f4f83a6925d97943c574b">tempest-AttachVolumeShelveTestJSON-1896381340</nova:project>
Apr 13 17:54:18 user nova-compute[71354]:       </nova:owner>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:root type="image" uuid="79730d5c-e1b4-45e4-8af6-6c1ce16e1154"/>
Apr 13 17:54:18 user nova-compute[71354]:       <nova:ports>
Apr 13 17:54:18 user nova-compute[71354]:         <nova:port uuid="72193ca5-011d-4cf8-b016-194d83952281">
Apr 13 17:54:18 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:54:18 user nova-compute[71354]:         </nova:port>
Apr 13 17:54:18 user nova-compute[71354]:       </nova:ports>
Apr 13 17:54:18 user nova-compute[71354]:     </nova:instance>
Apr 13 17:54:18 user nova-compute[71354]:   </metadata>
Apr 13 17:54:18 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:54:18 user nova-compute[71354]:     <system>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="serial">1753314b-bfd7-4e8b-986b-0253666ab8aa</entry>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="uuid">1753314b-bfd7-4e8b-986b-0253666ab8aa</entry>
Apr 13 17:54:18 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:54:18 user nova-compute[71354]:     </system>
Apr 13 17:54:18 user nova-compute[71354]:   </sysinfo>
Apr 13 17:54:18 user nova-compute[71354]:   <os>
Apr 13 17:54:18 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:54:18 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:54:18 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:54:18 user nova-compute[71354]:   </os>
Apr 13 17:54:18 user nova-compute[71354]:   <features>
Apr 13 17:54:18 user nova-compute[71354]:     <acpi/>
Apr 13 17:54:18 user nova-compute[71354]:     <apic/>
Apr 13 17:54:18 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:54:18 user nova-compute[71354]:   </features>
Apr 13 17:54:18 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:54:18 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:54:18 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:54:18 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:54:18 user nova-compute[71354]:   </clock>
Apr 13 17:54:18 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:54:18 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:54:18 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:54:18 user nova-compute[71354]:   </cpu>
Apr 13 17:54:18 user nova-compute[71354]:   <devices>
Apr 13 17:54:18 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:54:18 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:54:18 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk"/>
Apr 13 17:54:18 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:54:18 user nova-compute[71354]:     </disk>
Apr 13 17:54:18 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:54:18 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:54:18 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 17:54:18 user nova-compute[71354]:       <target dev="vdc" bus="virtio"/>
Apr 13 17:54:18 user nova-compute[71354]:       <serial>841bd7fe-de3a-41ad-b1c2-1e46cf6645e8</serial>
Apr 13 17:54:18 user nova-compute[71354]:     </disk>
Apr 13 17:54:18 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:54:18 user nova-compute[71354]:       <mac address="fa:16:3e:9b:5a:72"/>
Apr 13 17:54:18 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:18 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:54:18 user nova-compute[71354]:       <target dev="tap72193ca5-01"/>
Apr 13 17:54:18 user nova-compute[71354]:     </interface>
Apr 13 17:54:18 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:54:18 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/console.log" append="off"/>
Apr 13 17:54:18 user nova-compute[71354]:     </serial>
Apr 13 17:54:18 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:54:18 user nova-compute[71354]:     <video>
Apr 13 17:54:18 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:18 user nova-compute[71354]:     </video>
Apr 13 17:54:18 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:54:18 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:54:18 user nova-compute[71354]:     </rng>
Apr 13 17:54:18 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:54:18 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:54:18 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:54:18 user nova-compute[71354]:     </memballoon>
Apr 13 17:54:18 user nova-compute[71354]:   </devices>
Apr 13 17:54:18 user nova-compute[71354]: </domain>
Apr 13 17:54:18 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='79730d5c-e1b4-45e4-8af6-6c1ce16e1154',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-142800183',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:52:17.637427',shelved_host='user',shelved_image_id='79730d5c-e1b4-45e4-8af6-6c1ce16e1154'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG os_vif [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72193ca5-01, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72193ca5-01, col_values=(('external_ids', {'iface-id': '72193ca5-011d-4cf8-b016-194d83952281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5a:72', 'vm-uuid': '1753314b-bfd7-4e8b-986b-0253666ab8aa'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:18 user nova-compute[71354]: INFO os_vif [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01')
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No VIF found with MAC fa:16:3e:9b:5a:72, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:54:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:20 user nova-compute[71354]: WARNING nova.compute.manager [req-0a4112ec-35ad-46d5-a3f2-c6f4bd2089e8 req-f846cc07-9577-42e7-9b2c-c5f8adce6541 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 17:54:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408462.0318613, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Resumed (Lifecycle Event)
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:54:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance spawned successfully.
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:54:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408462.033946, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Started (Lifecycle Event)
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:54:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:54:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:22 user nova-compute[71354]: WARNING nova.compute.manager [req-ecc814f0-3467-4262-8431-c363bd56ef21 req-58db6fb9-b836-4218-89cd-d32be9f2360d service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 17:54:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e53a50ac-f3d0-4ea4-83f8-4031b18b4505 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.906s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:54:30 user nova-compute[71354]: INFO nova.compute.manager [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Rescuing
Apr 13 17:54:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:54:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:31 user nova-compute[71354]: WARNING nova.compute.manager [req-ff99b403-e45f-4a6b-bb4f-0ad2a90444b4 req-bfea2a79-d4f7-4061-bed4-a61f5e35d3cb service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state rescuing.
Apr 13 17:54:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance destroyed successfully.
Apr 13 17:54:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Attempting a stable device rescue
Apr 13 17:54:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 17:54:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Creating image(s)
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG nova.virt.images [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 269337d0-9772-4c29-8a73-2f74b0697546 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:54:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.part /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.part /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.converted" returned: 0 in 0.206s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.143s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3 --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3,backing_fmt=raw /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3,backing_fmt=raw /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue" returned: 0 in 0.046s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "e09bdd5f1985efca81d5ce686a78a49a241f3cc3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'migration_context' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start _get_guest_xml network_info=[{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:29:99:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '269337d0-9772-4c29-8a73-2f74b0697546', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '3fdcfe74-d773-4fde-925c-54bdbf76e027', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1774abdc-69cc-4755-b62a-c74bc1997944', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'serial': 'ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:33 user nova-compute[71354]: WARNING nova.compute.manager [req-d144feb7-6ef3-4d9e-9063-fb311252c1a9 req-0f8c7bc4-63ee-4559-ab3a-714e7ab3f428 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state rescuing.
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'numa_topology' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:33 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:33 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:33 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:33 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:33 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e76885-c541-48fa-a7d4-6bc4976a5aeb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rIzcOmiY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 17:54:33 user nova-compute[71354]: node.name = iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:54:33 user nova-compute[71354]: node.tpgt = -1
Apr 13 17:54:33 user nova-compute[71354]: node.startup = automatic
Apr 13 17:54:33 user nova-compute[71354]: node.leading_login = No
Apr 13 17:54:33 user nova-compute[71354]: iface.iscsi_ifacename = default
Apr 13 17:54:33 user nova-compute[71354]: iface.net_ifacename = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.ipaddress = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.prefix_len = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.hwaddress = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.transport_name = tcp
Apr 13 17:54:33 user nova-compute[71354]: iface.initiatorname = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.vlan_id = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.vlan_priority = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.vlan_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.iface_num = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.mtu = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.port = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.bootproto = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.subnet_mask = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.gateway = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_alt_client_id = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_dns = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_learn_iqn = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_vendor_id_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_vendor_id = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.dhcp_slp_da = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.fragmentation = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.gratuitous_arp = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.incoming_forwarding = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.tos_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.tos = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.ttl = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.delayed_ack = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.tcp_nagle = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.tcp_wsf_state = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.tcp_wsf = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.tcp_timer_scale = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.tcp_timestamp = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.redirect = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.def_task_mgmt_timeout = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.header_digest = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.data_digest = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.immediate_data = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.initial_r2t = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.data_seq_inorder = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.data_pdu_inorder = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.erl = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.max_receive_data_len = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.first_burst_len = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.max_outstanding_r2t = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.max_burst_len = 0
Apr 13 17:54:33 user nova-compute[71354]: iface.chap_auth = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.bidi_chap = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.strict_login_compliance = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.discovery_auth = <empty>
Apr 13 17:54:33 user nova-compute[71354]: iface.discovery_logout = <empty>
Apr 13 17:54:33 user nova-compute[71354]: node.discovery_address = <empty>
Apr 13 17:54:33 user nova-compute[71354]: node.discovery_port = 0
Apr 13 17:54:33 user nova-compute[71354]: node.discovery_type = static
Apr 13 17:54:33 user nova-compute[71354]: node.session.initial_cmdsn = 0
Apr 13 17:54:33 user nova-compute[71354]: node.session.initial_login_retry_max = 8
Apr 13 17:54:33 user nova-compute[71354]: node.session.xmit_thread_priority = -20
Apr 13 17:54:33 user nova-compute[71354]: node.session.cmds_max = 128
Apr 13 17:54:33 user nova-compute[71354]: node.session.queue_depth = 32
Apr 13 17:54:33 user nova-compute[71354]: node.session.nr_sessions = 1
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.authmethod = CHAP
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.username = rIzcOmiY
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.password = ***
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.username_in = <empty>
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.password_in = <empty>
Apr 13 17:54:33 user nova-compute[71354]: node.session.auth.chap_algs = MD5
Apr 13 17:54:33 user nova-compute[71354]: node.session.timeo.replacement_timeout = 120
Apr 13 17:54:33 user nova-compute[71354]: node.session.err_timeo.abort_timeout = 15
Apr 13 17:54:33 user nova-compute[71354]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 17:54:33 user nova-compute[71354]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 17:54:33 user nova-compute[71354]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.FastAbort = Yes
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.InitialR2T = No
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.ImmediateData = Yes
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.MaxConnections = 1
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 17:54:33 user nova-compute[71354]: node.session.iscsi.ERL = 0
Apr 13 17:54:33 user nova-compute[71354]: node.session.scan = manual
Apr 13 17:54:33 user nova-compute[71354]: node.session.reopen_max = 0
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].address = 172.16.0.220
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].port = 3260
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].startup = manual
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].tcp.window_size = 524288
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].tcp.type_of_service = 0
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].timeo.logout_timeout = 15
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].timeo.login_timeout = 15
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].timeo.auth_timeout = 45
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.DataDigest = None
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.IFMarker = No
Apr 13 17:54:33 user nova-compute[71354]: node.conn[0].iscsi.OFMarker = No
Apr 13 17:54:33 user nova-compute[71354]: # END RECORD
Apr 13 17:54:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[59396d98-e5e6-49ed-915d-f7452673f677]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0e649-d650-4b0b-85ca-f0ac11f932de]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIzcOmiY {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIzcOmiY" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde038c4-10c3-4ab3-9310-3e8957d075d6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIzcOmiY'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1484023-16bd-4a13-bda1-7f76e1ad0631]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e867611-aab3-4696-8d96-4770dc07624f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HCTL ('33', '0', '0', 0) found on session 21 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb02948-d09d-40fd-b884-ca76003590ef]: (4, ('0 0 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Searching for a device in session 21 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26465346532666234', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465346532666234', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-711902791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-711902791',id=20,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-msvxrede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:52:55Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=1774abdc-69cc-4755-b62a-c74bc1997944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:29:99:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:29:99:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:54:33 user nova-compute[71354]:   <uuid>1774abdc-69cc-4755-b62a-c74bc1997944</uuid>
Apr 13 17:54:33 user nova-compute[71354]:   <name>instance-00000014</name>
Apr 13 17:54:33 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:54:33 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:54:33 user nova-compute[71354]:   <metadata>
Apr 13 17:54:33 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:54:33 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-711902791</nova:name>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:54:33</nova:creationTime>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:54:33 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:54:33 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:owner>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 17:54:33 user nova-compute[71354]:       </nova:owner>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:54:33 user nova-compute[71354]:       <nova:ports>
Apr 13 17:54:33 user nova-compute[71354]:         <nova:port uuid="9fdd1b17-9f90-475f-b0a0-17ddea2c8c96">
Apr 13 17:54:33 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:54:33 user nova-compute[71354]:         </nova:port>
Apr 13 17:54:33 user nova-compute[71354]:       </nova:ports>
Apr 13 17:54:33 user nova-compute[71354]:     </nova:instance>
Apr 13 17:54:33 user nova-compute[71354]:   </metadata>
Apr 13 17:54:33 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:54:33 user nova-compute[71354]:     <system>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="serial">1774abdc-69cc-4755-b62a-c74bc1997944</entry>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="uuid">1774abdc-69cc-4755-b62a-c74bc1997944</entry>
Apr 13 17:54:33 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:54:33 user nova-compute[71354]:     </system>
Apr 13 17:54:33 user nova-compute[71354]:   </sysinfo>
Apr 13 17:54:33 user nova-compute[71354]:   <os>
Apr 13 17:54:33 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:54:33 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:54:33 user nova-compute[71354]:   </os>
Apr 13 17:54:33 user nova-compute[71354]:   <features>
Apr 13 17:54:33 user nova-compute[71354]:     <acpi/>
Apr 13 17:54:33 user nova-compute[71354]:     <apic/>
Apr 13 17:54:33 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:54:33 user nova-compute[71354]:   </features>
Apr 13 17:54:33 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:54:33 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:54:33 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:54:33 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:54:33 user nova-compute[71354]:   </clock>
Apr 13 17:54:33 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:54:33 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:54:33 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:54:33 user nova-compute[71354]:   </cpu>
Apr 13 17:54:33 user nova-compute[71354]:   <devices>
Apr 13 17:54:33 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:54:33 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:54:33 user nova-compute[71354]:       <source dev="/dev/sdb"/>
Apr 13 17:54:33 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:54:33 user nova-compute[71354]:       <serial>ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7</serial>
Apr 13 17:54:33 user nova-compute[71354]:     </disk>
Apr 13 17:54:33 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:54:33 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:54:33 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue"/>
Apr 13 17:54:33 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:54:33 user nova-compute[71354]:       <boot order="1"/>
Apr 13 17:54:33 user nova-compute[71354]:     </disk>
Apr 13 17:54:33 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:54:33 user nova-compute[71354]:       <mac address="fa:16:3e:29:99:e5"/>
Apr 13 17:54:33 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:33 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:54:33 user nova-compute[71354]:       <target dev="tap9fdd1b17-9f"/>
Apr 13 17:54:33 user nova-compute[71354]:     </interface>
Apr 13 17:54:33 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:54:33 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/console.log" append="off"/>
Apr 13 17:54:33 user nova-compute[71354]:     </serial>
Apr 13 17:54:33 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:54:33 user nova-compute[71354]:     <video>
Apr 13 17:54:33 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:33 user nova-compute[71354]:     </video>
Apr 13 17:54:33 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:54:33 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:54:33 user nova-compute[71354]:     </rng>
Apr 13 17:54:33 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:54:33 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:54:33 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:54:33 user nova-compute[71354]:     </memballoon>
Apr 13 17:54:33 user nova-compute[71354]:   </devices>
Apr 13 17:54:33 user nova-compute[71354]: </domain>
Apr 13 17:54:33 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:54:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance destroyed successfully.
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:29:99:e5, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:35 user nova-compute[71354]: WARNING nova.compute.manager [req-68617d88-52fd-4a0b-ad88-fc135800ec86 req-2e3b3880-64fc-40e0-be42-e08ee362f1df service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state rescuing.
Apr 13 17:54:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 1774abdc-69cc-4755-b62a-c74bc1997944 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408477.5062923, 1774abdc-69cc-4755-b62a-c74bc1997944 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Resumed (Lifecycle Event)
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ef886cfc-a549-499f-85fe-a083c20c3209 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:54:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408477.5066514, 1774abdc-69cc-4755-b62a-c74bc1997944 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Started (Lifecycle Event)
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:37 user nova-compute[71354]: WARNING nova.compute.manager [req-809b4267-2fa0-4736-b96b-e16c1aa74c0c req-a9cc2339-b11e-4f7d-a450-b9e83eeb4c7d service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state rescuing.
Apr 13 17:54:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:38 user nova-compute[71354]: INFO nova.compute.manager [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Terminating instance
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Instance destroyed successfully.
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.objects.instance [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lazy-loading 'resources' on Instance uuid bc89ac54-6844-45b9-8dac-c10d893b699b {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:45:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-743764397',display_name='tempest-ServersNegativeTestJSON-server-743764397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-743764397',id=2,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4fbca3daa10432c8abf5e8cc0dff050',ramdisk_id='',reservation_id='r-6ywzng84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-238465742',owner_user_name='tempest-ServersNegativeTestJSON-238465742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:46:13Z,user_data=None,user_id='b33d4309055340a4b42df540ca62d59f',uuid=bc89ac54-6844-45b9-8dac-c10d893b699b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converting VIF {"id": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "address": "fa:16:3e:17:73:cc", "network": {"id": "74134ba8-d8bf-4dbd-853e-3b5e62fad8e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1408915288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fbca3daa10432c8abf5e8cc0dff050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6431e14a-e7", "ovs_interfaceid": "6431e14a-e7e3-4cb5-9fe6-015c1debef03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG os_vif [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6431e14a-e7, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:38 user nova-compute[71354]: INFO os_vif [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:73:cc,bridge_name='br-int',has_traffic_filtering=True,id=6431e14a-e7e3-4cb5-9fe6-015c1debef03,network=Network(74134ba8-d8bf-4dbd-853e-3b5e62fad8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6431e14a-e7')
Apr 13 17:54:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Deleting instance files /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b_del
Apr 13 17:54:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Deletion of /opt/stack/data/nova/instances/bc89ac54-6844-45b9-8dac-c10d893b699b_del complete
Apr 13 17:54:38 user nova-compute[71354]: INFO nova.compute.manager [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 13 17:54:38 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:54:38 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:39 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Took 0.67 seconds to deallocate network for instance.
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-vif-deleted-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:39 user nova-compute[71354]: INFO nova.compute.manager [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Neutron deleted interface 6431e14a-e7e3-4cb5-9fe6-015c1debef03; detaching it from the instance and deleting it from the info cache
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.network.neutron [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-486ef52e-23d4-4cc8-8a9c-9d5400581ea4 req-12741d9c-1d0b-42c9-a0f3-f7fb08c3e668 service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Detach interface failed, port_id=6431e14a-e7e3-4cb5-9fe6-015c1debef03, reason: Instance bc89ac54-6844-45b9-8dac-c10d893b699b could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-vif-unplugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] No waiting events found dispatching network-vif-unplugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:39 user nova-compute[71354]: WARNING nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received unexpected event network-vif-unplugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance with vm_state deleted and task_state None.
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Acquiring lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] No waiting events found dispatching network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:39 user nova-compute[71354]: WARNING nova.compute.manager [req-11ffc4e5-a42a-4385-bdfa-92f451f1ea26 req-c173bb61-8595-469c-98f3-bcb60a3d693c service nova] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Received unexpected event network-vif-plugged-6431e14a-e7e3-4cb5-9fe6-015c1debef03 for instance with vm_state deleted and task_state None.
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:54:39 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:40 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Deleted allocations for instance bc89ac54-6844-45b9-8dac-c10d893b699b
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-66b7bd3a-47c0-4bef-8543-30161faacc66 tempest-ServersNegativeTestJSON-238465742 tempest-ServersNegativeTestJSON-238465742-project-member] Lock "bc89ac54-6844-45b9-8dac-c10d893b699b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'flavor' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:40 user nova-compute[71354]: INFO nova.compute.manager [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attaching volume dc848d65-78d3-466f-9c07-311725e1d7ba to /dev/vdb
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.utils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346e2a4-7632-4980-9488-02e82c736196]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c602356-d10a-4a07-976e-db101806f015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b125ee8a-1549-407e-aa45-8ced1cbd7ca7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a70217-ca5e-4c27-a5b7-286d011b73f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:40 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:54:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30557cd3-5f97-426d-b7f0-03d61ff5dc53]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG os_brick.utils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:40 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating existing volume attachment record: cdfbb905-7be6-4cd8-95eb-45ca08cab4fb {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:54:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:45 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:45 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:45 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d7028-910c-4d52-ae33-9112e4fe1035]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:54:45 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69b166-fd70-42d5-b640-7c37fa99a661]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d62ba-7262-4439-a149-a6d1ded209b1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367a5c7-28b3-47c9-b351-7a5aa53ac204]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b74c80-ba11-4501-b866-90e89331a01c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVlrLEtO'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0654883f-5309-4b6a-b333-9f66784d7c31]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8712db-b315-4251-80f0-b0f8bc51733a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074ef04-c0f8-44ff-aef2-f31d24055844]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:54:45 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6810697-fa48-4bfa-bc92-0dbb8e30d583]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecf383f-345a-48c2-ace2-be829b4e9b42]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:45 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:45 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60f815-b378-4798-9f12-f309626373c0]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:54:45 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'flavor' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:54:46 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:54:46 user nova-compute[71354]:   <source dev="/dev/sde"/>
Apr 13 17:54:46 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:54:46 user nova-compute[71354]:   <serial>dc848d65-78d3-466f-9c07-311725e1d7ba</serial>
Apr 13 17:54:46 user nova-compute[71354]: </disk>
Apr 13 17:54:46 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:78:5c:7c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8633f821-0658-4107-b997-609fa35baf47 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.757s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:47 user nova-compute[71354]: INFO nova.compute.manager [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Detaching volume 101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:54:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:47 user nova-compute[71354]: INFO nova.virt.block_device [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Attempting to driver detach volume 101df4ac-9f5e-4960-85e3-ccb7dc4be985 from mountpoint /dev/vdb
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Attempting to detach device vdb from instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:54:47 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:54:47 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:54:47 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:54:47 user nova-compute[71354]:   <serial>101df4ac-9f5e-4960-85e3-ccb7dc4be985</serial>
Apr 13 17:54:47 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:54:47 user nova-compute[71354]: </disk>
Apr 13 17:54:47 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:54:47 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdb from instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 from the persistent domain config.
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:54:47 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:54:47 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 17:54:47 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:54:47 user nova-compute[71354]:   <serial>101df4ac-9f5e-4960-85e3-ccb7dc4be985</serial>
Apr 13 17:54:47 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:54:47 user nova-compute[71354]: </disk>
Apr 13 17:54:47 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408487.8063445, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:54:47 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdb from instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 from the live domain config.
Apr 13 17:54:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvNZDMAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:47 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9745ac3-0db0-4e09-8760-93cc79feebbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:54:47 user nova-compute[71354]: No targets found.
Apr 13 17:54:47 user nova-compute[71354]: iSNS:
Apr 13 17:54:47 user nova-compute[71354]: No targets found.
Apr 13 17:54:47 user nova-compute[71354]: STATIC:
Apr 13 17:54:47 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985
Apr 13 17:54:47 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:47 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:47 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:54:47 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:47 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:47 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:54:47 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:47 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:47 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8
Apr 13 17:54:47 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:47 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:47 user nova-compute[71354]: FIRMWARE:
Apr 13 17:54:47 user nova-compute[71354]: No targets found.
Apr 13 17:54:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:54:47 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:54:47 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db55024-3352-449a-b930-cf5f0b44921c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a40ab8-485a-48a9-898f-bcf9c083be52]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:47 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc3549d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c400e9d0-bc83-4555-b765-ad6145ce1d62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe60cc4-facc-4b08-9872-de6bc279e915]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00651e8-75ae-455d-baa5-eb0507a75437]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:54:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e20cb4-af24-4107-9477-8491e829c1e2]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905be01-759a-472f-99fe-de1b81c507c8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf70d0-8bdf-445d-8217-d7afd5fa3775]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260]
Apr 13 17:54:48 user nova-compute[71354]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985, portal: 172.16.0.220,3260] successful.
Apr 13 17:54:48 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:101df4ac-9f5e-4960-85e3-ccb7dc4be985 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de5ea3-330d-44c2-8ad7-ba897f0e00a8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== disconnect_volume: return (323ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG nova.objects.instance [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c9a6ab93-f8ee-43cd-ab06-c98bbc320d11 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Stashing vm_state: active {{(pid=71354) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71354) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_requests' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:54:49 user nova-compute[71354]: INFO nova.compute.claims [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Claim successful on node user
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:49 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating resource usage from migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619
Apr 13 17:54:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:49 user nova-compute[71354]: WARNING nova.compute.manager [req-8881dfab-1bf3-459f-a295-6195a0aef7cc req-20d82843-df4d-4d39-af01-561cb64f8034 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state active and task_state powering-off.
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.534s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:50 user nova-compute[71354]: INFO nova.compute.manager [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Migrating
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:50 user nova-compute[71354]: INFO nova.compute.rpcapi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:54:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance destroyed successfully.
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-abb349fc-65a1-4762-bf8b-051d27cb3fe4 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Starting migrate_disk_and_power_off {{(pid=71354) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:51 user nova-compute[71354]: WARNING nova.compute.manager [req-9714ec3f-a88f-427d-95d8-cfb1a94ae167 req-510220e1-b0e7-46b2-acdf-234db01f9b57 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state resize_migrating.
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance destroyed successfully.
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067fbe09-ac, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:51 user nova-compute[71354]: INFO os_vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7ff53-7bfa-4ac6-99c4-de55869267b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:54:51 user nova-compute[71354]: No targets found.
Apr 13 17:54:51 user nova-compute[71354]: iSNS:
Apr 13 17:54:51 user nova-compute[71354]: No targets found.
Apr 13 17:54:51 user nova-compute[71354]: STATIC:
Apr 13 17:54:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:54:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:54:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8
Apr 13 17:54:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:54:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:54:51 user nova-compute[71354]: FIRMWARE:
Apr 13 17:54:51 user nova-compute[71354]: No targets found.
Apr 13 17:54:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:54:51 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:54:51 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f29801-e158-4152-9bb3-e3d2f1016954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:51 user nova-compute[71354]: WARNING nova.compute.manager [req-ad300d64-107d-41b7-bed0-1f89161d3e9e req-03732bb0-7154-41f7-b2e7-145d048f5081 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state None.
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e4aa8-470d-4af7-b0b7-87bee3a7ff14]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:51 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:51 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:54:51 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:54:51 user nova-compute[71354]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:54:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d40d00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669ed9c-220d-4fba-8ca3-7214633b35e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9a8fce-bf22-489b-a7b2-a6677a517c32]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84439da9-d890-4f3d-b3d7-13d63a74dcb9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27228db7-cf6d-499c-a2d1-71e58b5432fc]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc66632d-dcc8-4162-84eb-e382626e71e1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bb0be1-37a0-4788-a47d-6ccc20499877]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:54:52 user nova-compute[71354]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:54:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d81c4-2fc8-40e1-b247-f7c7f72b60ab]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (417ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_resize/disk /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "cp -r /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_resize/disk /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk" returned: 0 in 0.282s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_resize/disk.info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "cp -r /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_resize/disk.info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk.info" returned: 0 in 0.041s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:53 user nova-compute[71354]: WARNING nova.compute.manager [req-353fe0af-cec4-4749-ba03-0af9c936857d req-da2d9b37-ad36-43eb-af8c-f3222a4fad90 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state resize_migrating.
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408478.7384229, bc89ac54-6844-45b9-8dac-c10d893b699b => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:53 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] VM Stopped (Lifecycle Event)
Apr 13 17:54:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bf29f36a-f414-44f4-a389-6223604b9d3f None None] [instance: bc89ac54-6844-45b9-8dac-c10d893b699b] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Port 067fbe09-ace1-4188-a99f-ee4847a1a311 binding to destination host user is already ACTIVE {{(pid=71354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 17:54:54 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:54 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7717MB free_disk=26.232593536376953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:54 user nova-compute[71354]: INFO nova.compute.manager [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Rescuing
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Applying migration context for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 as it has an incoming, in-progress migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619. Migration status is post-migrating {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 17:54:54 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating resource usage from migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:55 user nova-compute[71354]: WARNING nova.compute.manager [req-bae9ba7f-ffe9-405a-9490-6b4a1c6b2afb req-fcf1e686-c91c-4ecf-b014-e5d24f8bd4ab service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state active and task_state rescuing.
Apr 13 17:54:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance destroyed successfully.
Apr 13 17:54:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Attempting rescue
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe7fcb7-767c-447e-bc03-1d9b367f8b10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 17:54:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Creating image(s)
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'trusted_certs' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad867db-ccaa-4b3f-a70f-c417cc369c6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db973f-0f4c-43a7-b3c0-3f465a1ecd4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33012ea4-c2fd-4f71-9317-53223330981f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:54:55 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:54:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a23889-7ccb-4a14-a78d-2ad2d682bb61]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:54:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue" returned: 0 in 0.060s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start _get_guest_xml network_info=[{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:23:6c:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'numa_topology' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:56 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:56 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'vcpu_model' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-787905959',display_name='tempest-ServerRescueNegativeTestJSON-server-787905959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-787905959',id=16,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-3jyfpoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:50:22Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=474af9f8-6700-4288-8133-a8dad4cf8a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:23:6c:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:23:6c:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:54:56 user nova-compute[71354]:   <uuid>474af9f8-6700-4288-8133-a8dad4cf8a88</uuid>
Apr 13 17:54:56 user nova-compute[71354]:   <name>instance-00000010</name>
Apr 13 17:54:56 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:54:56 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:54:56 user nova-compute[71354]:   <metadata>
Apr 13 17:54:56 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:54:56 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-787905959</nova:name>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:54:56</nova:creationTime>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:54:56 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:54:56 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:owner>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 17:54:56 user nova-compute[71354]:       </nova:owner>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:54:56 user nova-compute[71354]:       <nova:ports>
Apr 13 17:54:56 user nova-compute[71354]:         <nova:port uuid="bc084ec2-1969-42ed-a2d1-1e157a83f6ac">
Apr 13 17:54:56 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:54:56 user nova-compute[71354]:         </nova:port>
Apr 13 17:54:56 user nova-compute[71354]:       </nova:ports>
Apr 13 17:54:56 user nova-compute[71354]:     </nova:instance>
Apr 13 17:54:56 user nova-compute[71354]:   </metadata>
Apr 13 17:54:56 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:54:56 user nova-compute[71354]:     <system>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="serial">474af9f8-6700-4288-8133-a8dad4cf8a88</entry>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="uuid">474af9f8-6700-4288-8133-a8dad4cf8a88</entry>
Apr 13 17:54:56 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:54:56 user nova-compute[71354]:     </system>
Apr 13 17:54:56 user nova-compute[71354]:   </sysinfo>
Apr 13 17:54:56 user nova-compute[71354]:   <os>
Apr 13 17:54:56 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:54:56 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:54:56 user nova-compute[71354]:   </os>
Apr 13 17:54:56 user nova-compute[71354]:   <features>
Apr 13 17:54:56 user nova-compute[71354]:     <acpi/>
Apr 13 17:54:56 user nova-compute[71354]:     <apic/>
Apr 13 17:54:56 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:54:56 user nova-compute[71354]:   </features>
Apr 13 17:54:56 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:54:56 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:54:56 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:54:56 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:54:56 user nova-compute[71354]:   </clock>
Apr 13 17:54:56 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:54:56 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:54:56 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:54:56 user nova-compute[71354]:   </cpu>
Apr 13 17:54:56 user nova-compute[71354]:   <devices>
Apr 13 17:54:56 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:54:56 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:54:56 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue"/>
Apr 13 17:54:56 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:54:56 user nova-compute[71354]:     </disk>
Apr 13 17:54:56 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:54:56 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:54:56 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk"/>
Apr 13 17:54:56 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:54:56 user nova-compute[71354]:     </disk>
Apr 13 17:54:56 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:54:56 user nova-compute[71354]:       <mac address="fa:16:3e:23:6c:0c"/>
Apr 13 17:54:56 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:56 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:54:56 user nova-compute[71354]:       <target dev="tapbc084ec2-19"/>
Apr 13 17:54:56 user nova-compute[71354]:     </interface>
Apr 13 17:54:56 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:54:56 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/console.log" append="off"/>
Apr 13 17:54:56 user nova-compute[71354]:     </serial>
Apr 13 17:54:56 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:54:56 user nova-compute[71354]:     <video>
Apr 13 17:54:56 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:54:56 user nova-compute[71354]:     </video>
Apr 13 17:54:56 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:54:56 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:54:56 user nova-compute[71354]:     </rng>
Apr 13 17:54:56 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:54:56 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:54:56 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:54:56 user nova-compute[71354]:     </memballoon>
Apr 13 17:54:56 user nova-compute[71354]:   </devices>
Apr 13 17:54:56 user nova-compute[71354]: </domain>
Apr 13 17:54:56 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:54:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance destroyed successfully.
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:23:6c:0c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:54:56 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:57 user nova-compute[71354]: WARNING nova.compute.manager [req-c5a54d85-1a55-46af-8905-20741a98dbe4 req-bb47f1b2-4b96-4085-964c-174adc02c618 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state active and task_state rescuing.
Apr 13 17:54:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:59 user nova-compute[71354]: WARNING nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state active and task_state rescuing.
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:54:59 user nova-compute[71354]: WARNING nova.compute.manager [req-12d60105-fc06-4b9c-a161-570c764c9da0 req-cedb2ea7-f24c-4f09-88b8-0e6756ab87bc service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state active and task_state rescuing.
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 474af9f8-6700-4288-8133-a8dad4cf8a88 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408499.9119897, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:59 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Resumed (Lifecycle Event)
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37d23b5a-3e4b-4d80-b4a0-e1c61d3d4c24 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:54:59 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408499.9132283, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:54:59 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Started (Lifecycle Event)
Apr 13 17:54:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Starting finish_migration {{(pid=71354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 17:55:00 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating image(s)
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Cannot resize image /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Ensure instance console log exists: /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start _get_guest_xml network_info=[{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'f79ad85e-51ec-4d52-8647-19c97dcf067e', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08984ef0-6db9-4a60-b5b9-a6325ec531b1', 'attached_at': '2023-04-13T17:55:00.000000', 'detached_at': '', 'volume_id': 'dc848d65-78d3-466f-9c07-311725e1d7ba', 'serial': 'dc848d65-78d3-466f-9c07-311725e1d7ba'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:55:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:55:00 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:01 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:01 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:01 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9fe69b-51d3-48fb-8224-112cae20eec1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:55:01 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f956050-b9ca-444b-a880-d6f37c6a618d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b629e3-96d1-4900-bdda-d6e9f1067c2f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12de70-ebff-4860-aaa1-be9a0caa285e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c480c1-c916-4187-b502-44b0a74b4acc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVlrLEtO'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01242b85-7894-433e-893b-05a2fd8cedfb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb6b7d-ee22-4f0e-935f-f86635dd7b73]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[591f39ef-d2b7-409c-9585-d6ad05f4133e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:55:01 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd7d56-06a6-4b1a-8dd0-2e480094401f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60777520-4c9c-48a3-94af-a8e0fd37b6b8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:01 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5411cf-afdc-4a79-9c95-4b6d8cf06c50]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:55:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:55:02 user nova-compute[71354]:   <uuid>08984ef0-6db9-4a60-b5b9-a6325ec531b1</uuid>
Apr 13 17:55:02 user nova-compute[71354]:   <name>instance-00000003</name>
Apr 13 17:55:02 user nova-compute[71354]:   <memory>196608</memory>
Apr 13 17:55:02 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:55:02 user nova-compute[71354]:   <metadata>
Apr 13 17:55:02 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:02 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-127366011</nova:name>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:55:00</nova:creationTime>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:flavor name="m1.micro">
Apr 13 17:55:02 user nova-compute[71354]:         <nova:memory>192</nova:memory>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:02 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:owner>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 17:55:02 user nova-compute[71354]:       </nova:owner>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:02 user nova-compute[71354]:       <nova:ports>
Apr 13 17:55:02 user nova-compute[71354]:         <nova:port uuid="067fbe09-ace1-4188-a99f-ee4847a1a311">
Apr 13 17:55:02 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:55:02 user nova-compute[71354]:         </nova:port>
Apr 13 17:55:02 user nova-compute[71354]:       </nova:ports>
Apr 13 17:55:02 user nova-compute[71354]:     </nova:instance>
Apr 13 17:55:02 user nova-compute[71354]:   </metadata>
Apr 13 17:55:02 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:55:02 user nova-compute[71354]:     <system>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="serial">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="uuid">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:55:02 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:55:02 user nova-compute[71354]:     </system>
Apr 13 17:55:02 user nova-compute[71354]:   </sysinfo>
Apr 13 17:55:02 user nova-compute[71354]:   <os>
Apr 13 17:55:02 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:55:02 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:55:02 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:55:02 user nova-compute[71354]:   </os>
Apr 13 17:55:02 user nova-compute[71354]:   <features>
Apr 13 17:55:02 user nova-compute[71354]:     <acpi/>
Apr 13 17:55:02 user nova-compute[71354]:     <apic/>
Apr 13 17:55:02 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:55:02 user nova-compute[71354]:   </features>
Apr 13 17:55:02 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:55:02 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:55:02 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:55:02 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:55:02 user nova-compute[71354]:   </clock>
Apr 13 17:55:02 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:55:02 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:55:02 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:55:02 user nova-compute[71354]:   </cpu>
Apr 13 17:55:02 user nova-compute[71354]:   <devices>
Apr 13 17:55:02 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:55:02 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:55:02 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk"/>
Apr 13 17:55:02 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:55:02 user nova-compute[71354]:     </disk>
Apr 13 17:55:02 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:55:02 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:02 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 17:55:02 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:55:02 user nova-compute[71354]:       <serial>dc848d65-78d3-466f-9c07-311725e1d7ba</serial>
Apr 13 17:55:02 user nova-compute[71354]:     </disk>
Apr 13 17:55:02 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:55:02 user nova-compute[71354]:       <mac address="fa:16:3e:78:5c:7c"/>
Apr 13 17:55:02 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:02 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:55:02 user nova-compute[71354]:       <target dev="tap067fbe09-ac"/>
Apr 13 17:55:02 user nova-compute[71354]:     </interface>
Apr 13 17:55:02 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:55:02 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log" append="off"/>
Apr 13 17:55:02 user nova-compute[71354]:     </serial>
Apr 13 17:55:02 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:55:02 user nova-compute[71354]:     <video>
Apr 13 17:55:02 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:02 user nova-compute[71354]:     </video>
Apr 13 17:55:02 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:55:02 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:55:02 user nova-compute[71354]:     </rng>
Apr 13 17:55:02 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:55:02 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:55:02 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:55:02 user nova-compute[71354]:     </memballoon>
Apr 13 17:55:02 user nova-compute[71354]:   </devices>
Apr 13 17:55:02 user nova-compute[71354]: </domain>
Apr 13 17:55:02 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:78:5c:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG os_vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067fbe09-ac, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067fbe09-ac, col_values=(('external_ids', {'iface-id': '067fbe09-ace1-4188-a99f-ee4847a1a311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5c:7c', 'vm-uuid': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:02 user nova-compute[71354]: INFO os_vif [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:78:5c:7c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:04 user nova-compute[71354]: WARNING nova.compute.manager [req-0005aeb0-1dae-47fc-b7e1-88bd1a75ca11 req-0dcf07a3-e88f-42ad-b19a-9369e930f554 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state resize_finish.
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:05 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408490.3372626, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:05 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Stopped (Lifecycle Event)
Apr 13 17:55:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8e0642c9-50f9-4f43-8bf5-e299e5fe085c None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8e0642c9-50f9-4f43-8bf5-e299e5fe085c None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 08984ef0-6db9-4a60-b5b9-a6325ec531b1 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408506.1743245, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Resumed (Lifecycle Event)
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:55:06 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance running successfully.
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Failed to set time: agent not configured {{(pid=71354) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ec05da67-0c52-4d23-b01d-6484c063732d tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] finish_migration finished successfully. {{(pid=71354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408506.1760476, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Started (Lifecycle Event)
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:06 user nova-compute[71354]: WARNING nova.compute.manager [req-fae6f308-1497-4cbc-a1ca-517298f28ede req-4458aff3-e957-4e04-9015-2e01f0d9d928 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state resize_finish.
Apr 13 17:55:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:12 user nova-compute[71354]: INFO nova.compute.manager [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Unshelving
Apr 13 17:55:12 user nova-compute[71354]: INFO nova.virt.block_device [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Booting with volume 520be0ee-ea06-4b16-8773-a8d5b9e40c87 at /dev/vda
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.utils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc594c08-d3d5-4752-b71c-66def0af26a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f713085-b38f-463a-a69a-5a4a15585fd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff5a13-0e11-4160-b4f6-941b56a7e0b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e951fff-9e2d-4022-a8c6-0f4f885dc370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:12 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:55:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e6af9d-6cd5-4c77-8e98-d3943d344be6]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG os_brick.utils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating existing volume attachment record: 70e40ef7-80a1-4d45-91e1-27ee93c6155a {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:55:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-changed-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing instance network info cache due to event network-changed-274ea36d-e1f3-418a-9afa-173db904ef77. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing network info cache for port 274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'flavor' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'pci_requests' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG nova.policy [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c859ceec3df54c6ab1ae98a2c5320c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b120144ed4294837a716e156b12222e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:17 user nova-compute[71354]: INFO nova.compute.manager [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Attaching volume c60a8519-20b4-4b4e-8b21-368ebb46656e to /dev/vdb
Apr 13 17:55:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updated VIF entry in instance network info cache for port 274ea36d-e1f3-418a-9afa-173db904ef77. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ee0e3ded-f693-462d-b2d9-b3c3671913c6 req-3795457e-4872-41ea-9b0e-4dd2fab6b511 service nova] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb14a4-1d38-416f-ba51-f8bb38ae4ab9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b6d85-0cb1-47d7-8a2f-9515735cb615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5c080a-71f2-43fe-82e5-dcc069403918]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e5126-aae5-464d-ac30-62e387ee1a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:17 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:55:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e557addf-e867-4199-9d56-7fa4b7062bde]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating existing volume attachment record: 13445d37-ccd9-41b2-a463-08a328cb1669 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Successfully created port: 552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:55:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'pci_requests' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'numa_topology' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:55:18 user nova-compute[71354]: INFO nova.compute.claims [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Claim successful on node user
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Successfully updated port: 552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-changed-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing instance network info cache due to event network-changed-552a278f-c1f9-4704-b9d1-67b2d41328f0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:55:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:19 user nova-compute[71354]: INFO nova.network.neutron [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating port 8064fded-37fe-474e-bf38-2f6c094dd0d0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.neutron [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.neutron [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Refreshing network info cache for port 552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG os_vif [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap552a278f-c1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap552a278f-c1, col_values=(('external_ids', {'iface-id': '552a278f-c1f9-4704-b9d1-67b2d41328f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:23:8a', 'vm-uuid': 'd0042ccb-5c99-4880-8ec4-3a3c54769d6d'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:19 user nova-compute[71354]: INFO os_vif [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1')
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] attach device xml: <interface type="ethernet">
Apr 13 17:55:19 user nova-compute[71354]:   <mac address="fa:16:3e:9d:23:8a"/>
Apr 13 17:55:19 user nova-compute[71354]:   <model type="virtio"/>
Apr 13 17:55:19 user nova-compute[71354]:   <mtu size="1442"/>
Apr 13 17:55:19 user nova-compute[71354]:   <target dev="tap552a278f-c1"/>
Apr 13 17:55:19 user nova-compute[71354]: </interface>
Apr 13 17:55:19 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:55:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name hda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No VIF found with MAC fa:16:3e:2b:9c:29, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:20 user nova-compute[71354]:   <nova:package version="0.0.0"/>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:name>tempest-device-tagging-server-928673615</nova:name>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:creationTime>2023-04-13 17:55:20</nova:creationTime>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:flavor name="m1.nano">
Apr 13 17:55:20 user nova-compute[71354]:     <nova:memory>128</nova:memory>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:disk>1</nova:disk>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:swap>0</nova:swap>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:20 user nova-compute[71354]:   </nova:flavor>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:owner>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:user uuid="c859ceec3df54c6ab1ae98a2c5320c2a">tempest-TaggedAttachmentsTest-1546533741-project-member</nova:user>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:project uuid="b120144ed4294837a716e156b12222e3">tempest-TaggedAttachmentsTest-1546533741</nova:project>
Apr 13 17:55:20 user nova-compute[71354]:   </nova:owner>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:20 user nova-compute[71354]:   <nova:ports>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:port uuid="274ea36d-e1f3-418a-9afa-173db904ef77">
Apr 13 17:55:20 user nova-compute[71354]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:55:20 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:20 user nova-compute[71354]:     <nova:port uuid="552a278f-c1f9-4704-b9d1-67b2d41328f0">
Apr 13 17:55:20 user nova-compute[71354]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Apr 13 17:55:20 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:20 user nova-compute[71354]:   </nova:ports>
Apr 13 17:55:20 user nova-compute[71354]: </nova:instance>
Apr 13 17:55:20 user nova-compute[71354]:  {{(pid=71354) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-58dd9d25-e4df-4cc9-9b5b-2c71a72c96ab tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.106s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'flavor' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:21 user nova-compute[71354]: WARNING nova.compute.manager [req-37efbf23-846e-4705-adde-1624a488f842 req-5d017898-53ff-46f0-a3a4-aede19f94b5f service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance with vm_state active and task_state None.
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:21 user nova-compute[71354]: INFO nova.compute.manager [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Attaching volume 157b095b-a1e5-4109-848a-7cc1061e0a61 to /dev/vdb
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.utils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0debbc-537b-4d92-93c4-1cc4afbf9045]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d6532-051b-4c4e-a5a0-4ed5c3d448b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9db8ce5-f791-453f-ad72-1c5af280902b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[676cd8c6-865a-495a-b7a6-dc622f55d30b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:55:21 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fceb3-d5b8-477d-8eab-21f60e8a4c1c]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG os_brick.utils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating existing volume attachment record: 37fe0d9f-1060-4db6-a1ed-29c348dc6f76 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updated VIF entry in instance network info cache for port 552a278f-c1f9-4704-b9d1-67b2d41328f0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3cd959c4-2fe5-41a8-80f6-5954eb55ed83 req-1765e33e-6bca-46b4-92cb-fa5e4ea29961 service nova] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:55:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Creating image(s)
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Ensure instance console log exists: /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start _get_guest_xml network_info=[{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '70e40ef7-80a1-4d45-91e1-27ee93c6155a', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc1716d8-163a-4a50-8b3a-dbde50340fb8', 'attached_at': '', 'detached_at': '', 'volume_id': '520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'serial': '520be0ee-ea06-4b16-8773-a8d5b9e40c87'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:55:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:22 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac515a-ab54-471b-802b-32b42df3d813]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:55:22 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d3b72-0c61-4b1b-9159-266fdf208846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87] added
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[70995768-0829-4155-bca3-25bae421992e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cd58ec-4fe9-4017-9e5b-1fa50f7b59cd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnhzMFwD {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnhzMFwD" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96d9ad-6c21-4c80-b60f-49c05f362ff7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PnhzMFwD'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64751f7-d90d-4d8b-8638-1a9126f0372e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202789d-6f1a-4289-8d30-c9c85a97301e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abae470-4a4c-490a-960c-7d4890f29845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]
Apr 13 17:55:22 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1faf8-01da-4f55-9b74-00411d9d64f8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fffb87-a41a-4930-a17f-eedb32b6ec55]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:22 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c7719a-707d-4b32-87c0-3fbf7ebb8aaa]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:55:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing instance network info cache due to event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26434353338303265', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353338303265', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-822246976',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:55:12Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'pci_devices' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:55:23 user nova-compute[71354]:   <uuid>dc1716d8-163a-4a50-8b3a-dbde50340fb8</uuid>
Apr 13 17:55:23 user nova-compute[71354]:   <name>instance-00000013</name>
Apr 13 17:55:23 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:55:23 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:55:23 user nova-compute[71354]:   <metadata>
Apr 13 17:55:23 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:23 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:55:23 user nova-compute[71354]:       <nova:name>tempest-TestShelveInstance-server-1107166628</nova:name>
Apr 13 17:55:23 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:55:22</nova:creationTime>
Apr 13 17:55:23 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:55:23 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:23 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:55:23 user nova-compute[71354]:       <nova:owner>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:user uuid="8b8e4096bfa5458b81aa51dc55394cb9">tempest-TestShelveInstance-2002875852-project-member</nova:user>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:project uuid="1775be5ea4c540b0a67bfe3468fd5901">tempest-TestShelveInstance-2002875852</nova:project>
Apr 13 17:55:23 user nova-compute[71354]:       </nova:owner>
Apr 13 17:55:23 user nova-compute[71354]:       <nova:ports>
Apr 13 17:55:23 user nova-compute[71354]:         <nova:port uuid="8064fded-37fe-474e-bf38-2f6c094dd0d0">
Apr 13 17:55:23 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 17:55:23 user nova-compute[71354]:         </nova:port>
Apr 13 17:55:23 user nova-compute[71354]:       </nova:ports>
Apr 13 17:55:23 user nova-compute[71354]:     </nova:instance>
Apr 13 17:55:23 user nova-compute[71354]:   </metadata>
Apr 13 17:55:23 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:55:23 user nova-compute[71354]:     <system>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="serial">dc1716d8-163a-4a50-8b3a-dbde50340fb8</entry>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="uuid">dc1716d8-163a-4a50-8b3a-dbde50340fb8</entry>
Apr 13 17:55:23 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:55:23 user nova-compute[71354]:     </system>
Apr 13 17:55:23 user nova-compute[71354]:   </sysinfo>
Apr 13 17:55:23 user nova-compute[71354]:   <os>
Apr 13 17:55:23 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:55:23 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:55:23 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:55:23 user nova-compute[71354]:   </os>
Apr 13 17:55:23 user nova-compute[71354]:   <features>
Apr 13 17:55:23 user nova-compute[71354]:     <acpi/>
Apr 13 17:55:23 user nova-compute[71354]:     <apic/>
Apr 13 17:55:23 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:55:23 user nova-compute[71354]:   </features>
Apr 13 17:55:23 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:55:23 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:55:23 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:55:23 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:55:23 user nova-compute[71354]:   </clock>
Apr 13 17:55:23 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:55:23 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:55:23 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:55:23 user nova-compute[71354]:   </cpu>
Apr 13 17:55:23 user nova-compute[71354]:   <devices>
Apr 13 17:55:23 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:55:23 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:23 user nova-compute[71354]:       <source dev="/dev/sde"/>
Apr 13 17:55:23 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:55:23 user nova-compute[71354]:       <serial>520be0ee-ea06-4b16-8773-a8d5b9e40c87</serial>
Apr 13 17:55:23 user nova-compute[71354]:     </disk>
Apr 13 17:55:23 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:55:23 user nova-compute[71354]:       <mac address="fa:16:3e:cc:87:cd"/>
Apr 13 17:55:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:23 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:55:23 user nova-compute[71354]:       <target dev="tap8064fded-37"/>
Apr 13 17:55:23 user nova-compute[71354]:     </interface>
Apr 13 17:55:23 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:55:23 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8/console.log" append="off"/>
Apr 13 17:55:23 user nova-compute[71354]:     </serial>
Apr 13 17:55:23 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:55:23 user nova-compute[71354]:     <video>
Apr 13 17:55:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:23 user nova-compute[71354]:     </video>
Apr 13 17:55:23 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:55:23 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:55:23 user nova-compute[71354]:     </rng>
Apr 13 17:55:23 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:55:23 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:55:23 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:55:23 user nova-compute[71354]:     </memballoon>
Apr 13 17:55:23 user nova-compute[71354]:   </devices>
Apr 13 17:55:23 user nova-compute[71354]: </domain>
Apr 13 17:55:23 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-822246976',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:55:12Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG os_vif [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8064fded-37, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8064fded-37, col_values=(('external_ids', {'iface-id': '8064fded-37fe-474e-bf38-2f6c094dd0d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:87:cd', 'vm-uuid': 'dc1716d8-163a-4a50-8b3a-dbde50340fb8'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:23 user nova-compute[71354]: INFO os_vif [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37')
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updated VIF entry in instance network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] No VIF found with MAC fa:16:3e:cc:87:cd, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:23 user nova-compute[71354]: WARNING nova.compute.manager [req-8e893360-873e-43b8-b421-00a1ad1c9440 req-6d12c13f-cc3b-42bc-88f0-080b4069e41c service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance with vm_state active and task_state None.
Apr 13 17:55:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:25 user nova-compute[71354]: WARNING nova.compute.manager [req-9fd830e7-f0c8-4b74-bb50-b20d8aee0785 req-20e966b3-bb66-455e-b82d-bfeeb9643a0d service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfBKmNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:26 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:26 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:26 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc705b0-8b30-4502-a814-8a98765caa84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:55:26 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c592c-ff00-4f89-9d82-dcc00d21b6ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e] added
Apr 13 17:55:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[876e01fc-0fc2-4934-beb8-47d9d2495ce5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7d0d4-8ecc-410c-b790-f9a67f25b385]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfBKmNTj {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dfBKmNTj" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[715203d4-4b18-4342-a578-2bbf32c63e43]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dfBKmNTj'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87b1aa-0410-4e1d-9381-9ed0df19f0ed]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4394c1f-f92c-4944-8eef-166c5f3ed6ac]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfaa0c3-ff64-46e7-ba6b-c868e1ac91bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260]
Apr 13 17:55:27 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b8d78-4e3b-4c3a-bbac-f7f1aabaeae2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf7ce3-de4e-4767-b1ac-6f4b9ff9b2b6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:27 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:27 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408527.169682, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Resumed (Lifecycle Event)
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded383d2-6950-4236-875c-095f503ba7a6]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfBKmNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:55:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance spawned successfully.
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408527.1734083, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Started (Lifecycle Event)
Apr 13 17:55:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-85145a29-7ae8-4451-85e2-6b6ce198e1aa tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.950s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:27 user nova-compute[71354]: WARNING nova.compute.manager [req-4d999f00-415f-446e-bbb6-1a08ffb8154a req-0cf4bf1f-1670-4851-8f9c-5f19a7fea804 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state active and task_state None.
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23461316635666437', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461316635666437', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:55:28 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:28 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 17:55:28 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:55:28 user nova-compute[71354]:   <serial>c60a8519-20b4-4b4e-8b21-368ebb46656e</serial>
Apr 13 17:55:28 user nova-compute[71354]: </disk>
Apr 13 17:55:28 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXBpEGma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:28 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:28 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:28 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e539f131-a68e-4ab8-97ce-936de2558978]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:55:28 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be03bc1-5082-4233-b435-a6ed78083836]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61] added
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:55:28 user nova-compute[71354]: INFO nova.compute.claims [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Claim successful on node user
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b367e8a4-ca71-463d-9688-0193122dce1f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd8b12-31ef-4d48-81e0-5b6f01aa371b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXBpEGma {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXBpEGma" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8da49e-b67d-416c-aaab-50272a456b1c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cXBpEGma'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fe409-9a7f-4dc7-8ef3-5f68b4277f21]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ebd9fe-d476-4d68-ac0f-323871754824]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b82dd-d4a9-4e98-af8b-47c84a5fff74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260]
Apr 13 17:55:28 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06dbeaf-87e1-4b8a-9123-45327e99f2e5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09049b5-b7ba-4d82-a00e-5cc354ae2831]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:28 user nova-compute[71354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)
Apr 13 17:55:28 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] No VIF found with MAC fa:16:3e:34:15:00, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11fb4ff-1a91-440c-80ff-52c08152a449]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXBpEGma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-72acf495-c7b5-4eb6-9d85-a5d1ae9383f0 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.744s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:28 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:55:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.policy [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:55:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Creating image(s)
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "/opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "/opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "/opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.194s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk 1073741824" returned: 0 in 0.057s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26238613033333462', 'path': '/dev/sdg'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238613033333462', 'path': '/dev/sdg'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'flavor' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:55:29 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:29 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 17:55:29 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:55:29 user nova-compute[71354]:   <serial>157b095b-a1e5-4109-848a-7cc1061e0a61</serial>
Apr 13 17:55:29 user nova-compute[71354]: </disk>
Apr 13 17:55:29 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:55:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Cannot resize image /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'migration_context' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Ensure instance console log exists: /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Successfully created port: b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No BDM found with device name hda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] No VIF found with MAC fa:16:3e:2b:9c:29, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3e405f42-865e-4a6f-9021-a91a716a5773 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.438s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing instance network info cache due to event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.network.neutron [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:31 user nova-compute[71354]: INFO nova.compute.manager [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Detaching volume 157b095b-a1e5-4109-848a-7cc1061e0a61
Apr 13 17:55:31 user nova-compute[71354]: INFO nova.virt.block_device [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Attempting to driver detach volume 157b095b-a1e5-4109-848a-7cc1061e0a61 from mountpoint /dev/vdb
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Attempting to detach device vdb from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:55:31 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:31 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 17:55:31 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:55:31 user nova-compute[71354]:   <serial>157b095b-a1e5-4109-848a-7cc1061e0a61</serial>
Apr 13 17:55:31 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 17:55:31 user nova-compute[71354]: </disk>
Apr 13 17:55:31 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully detached device vdb from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the persistent domain config.
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:55:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:55:31 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:31 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 17:55:31 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:55:31 user nova-compute[71354]:   <serial>157b095b-a1e5-4109-848a-7cc1061e0a61</serial>
Apr 13 17:55:31 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 17:55:31 user nova-compute[71354]: </disk>
Apr 13 17:55:31 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408532.419971, d0042ccb-5c99-4880-8ec4-3a3c54769d6d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:55:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully detached device vdb from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the live domain config.
Apr 13 17:55:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXBpEGma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:32 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3329f866-55ec-4f7d-b4d0-676e924f03db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:55:32 user nova-compute[71354]: No targets found.
Apr 13 17:55:32 user nova-compute[71354]: iSNS:
Apr 13 17:55:32 user nova-compute[71354]: No targets found.
Apr 13 17:55:32 user nova-compute[71354]: STATIC:
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8
Apr 13 17:55:32 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:32 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:32 user nova-compute[71354]: FIRMWARE:
Apr 13 17:55:32 user nova-compute[71354]: No targets found.
Apr 13 17:55:32 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:55:32 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:55:32 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d5cfa0-4ff9-4143-85bc-70935917b4c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab0e98-2ddd-4bb3-8ea5-f2798dcc3476]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:32 user nova-compute[71354]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 (non-flash)
Apr 13 17:55:32 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d43565f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61'): ({'sdg'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Removing single pathed devices sdg {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[62334267-bafa-4506-ae76-a978499e8aa1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[612dd4fc-ea07-4b56-a6b9-2d7eb20c8b57]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Flushing IO for device /dev/sdg {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635df47-a46b-459a-8406-2280fd0ed5f2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.277s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e3c01-f8cb-416b-95f1-398b1dd92ba4]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fb622d-3e04-48d8-96f5-87e49a906d97]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6966531-9e42-4be3-b168-6e20eca0cd35]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260]
Apr 13 17:55:33 user nova-compute[71354]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157b095b-a1e5-4109-848a-7cc1061e0a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd033079-7f33-444d-b97f-2f68ea3e243e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.622s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] <== disconnect_volume: return (625ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updated VIF entry in instance network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d10bb3-af4d-4702-94aa-e5a8bfc7d091 req-8e0ed294-c4f5-4ddf-9aa2-e6dd015cd732 service nova] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Successfully updated port: b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquired lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing instance network info cache due to event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Acquiring lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Releasing lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Instance network_info: |[{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Acquired lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Start _get_guest_xml network_info=[{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:55:33 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:33 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-415392179',display_name='tempest-TestStampPattern-server-415392179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-415392179',id=23,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-23hzw7tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:55:29Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=9851b648-0b93-441b-9912-2216b528d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'pci_devices' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:55:33 user nova-compute[71354]:   <uuid>9851b648-0b93-441b-9912-2216b528d030</uuid>
Apr 13 17:55:33 user nova-compute[71354]:   <name>instance-00000017</name>
Apr 13 17:55:33 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:55:33 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:55:33 user nova-compute[71354]:   <metadata>
Apr 13 17:55:33 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:33 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:name>tempest-TestStampPattern-server-415392179</nova:name>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:55:33</nova:creationTime>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:55:33 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:33 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:owner>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:user uuid="2b565bc35a4742808d360a395858134b">tempest-TestStampPattern-1307048889-project-member</nova:user>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:project uuid="433b58054cc942efad3646ebf4ff286e">tempest-TestStampPattern-1307048889</nova:project>
Apr 13 17:55:33 user nova-compute[71354]:       </nova:owner>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:33 user nova-compute[71354]:       <nova:ports>
Apr 13 17:55:33 user nova-compute[71354]:         <nova:port uuid="b13328b5-41f1-4f0d-a862-d2e286c0602f">
Apr 13 17:55:33 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:55:33 user nova-compute[71354]:         </nova:port>
Apr 13 17:55:33 user nova-compute[71354]:       </nova:ports>
Apr 13 17:55:33 user nova-compute[71354]:     </nova:instance>
Apr 13 17:55:33 user nova-compute[71354]:   </metadata>
Apr 13 17:55:33 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:55:33 user nova-compute[71354]:     <system>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="serial">9851b648-0b93-441b-9912-2216b528d030</entry>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="uuid">9851b648-0b93-441b-9912-2216b528d030</entry>
Apr 13 17:55:33 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:55:33 user nova-compute[71354]:     </system>
Apr 13 17:55:33 user nova-compute[71354]:   </sysinfo>
Apr 13 17:55:33 user nova-compute[71354]:   <os>
Apr 13 17:55:33 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:55:33 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:55:33 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:55:33 user nova-compute[71354]:   </os>
Apr 13 17:55:33 user nova-compute[71354]:   <features>
Apr 13 17:55:33 user nova-compute[71354]:     <acpi/>
Apr 13 17:55:33 user nova-compute[71354]:     <apic/>
Apr 13 17:55:33 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:55:33 user nova-compute[71354]:   </features>
Apr 13 17:55:33 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:55:33 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:55:33 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:55:33 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:55:33 user nova-compute[71354]:   </clock>
Apr 13 17:55:33 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:55:33 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:55:33 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:55:33 user nova-compute[71354]:   </cpu>
Apr 13 17:55:33 user nova-compute[71354]:   <devices>
Apr 13 17:55:33 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:55:33 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:55:33 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk"/>
Apr 13 17:55:33 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:55:33 user nova-compute[71354]:     </disk>
Apr 13 17:55:33 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:55:33 user nova-compute[71354]:       <mac address="fa:16:3e:30:29:50"/>
Apr 13 17:55:33 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:33 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:55:33 user nova-compute[71354]:       <target dev="tapb13328b5-41"/>
Apr 13 17:55:33 user nova-compute[71354]:     </interface>
Apr 13 17:55:33 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:55:33 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/console.log" append="off"/>
Apr 13 17:55:33 user nova-compute[71354]:     </serial>
Apr 13 17:55:33 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:55:33 user nova-compute[71354]:     <video>
Apr 13 17:55:33 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:55:33 user nova-compute[71354]:     </video>
Apr 13 17:55:33 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:55:33 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:55:33 user nova-compute[71354]:     </rng>
Apr 13 17:55:33 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:55:33 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:55:33 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:55:33 user nova-compute[71354]:     </memballoon>
Apr 13 17:55:33 user nova-compute[71354]:   </devices>
Apr 13 17:55:33 user nova-compute[71354]: </domain>
Apr 13 17:55:33 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-415392179',display_name='tempest-TestStampPattern-server-415392179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-415392179',id=23,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-23hzw7tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:55:29Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=9851b648-0b93-441b-9912-2216b528d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG os_vif [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb13328b5-41, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb13328b5-41, col_values=(('external_ids', {'iface-id': 'b13328b5-41f1-4f0d-a862-d2e286c0602f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:29:50', 'vm-uuid': '9851b648-0b93-441b-9912-2216b528d030'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:55:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:33 user nova-compute[71354]: INFO os_vif [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41')
Apr 13 17:55:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'flavor' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No VIF found with MAC fa:16:3e:30:29:50, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-de9feeb9-1723-4762-bf7e-a1779c578230 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.340s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-552a278f-c1f9-4704-b9d1-67b2d41328f0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-552a278f-c1f9-4704-b9d1-67b2d41328f0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.objects.instance [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'flavor' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface> {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface> {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Attempting to detach device tap552a278f-c1 from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] detach device xml: <interface type="ethernet">
Apr 13 17:55:34 user nova-compute[71354]:   <mac address="fa:16:3e:9d:23:8a"/>
Apr 13 17:55:34 user nova-compute[71354]:   <model type="virtio"/>
Apr 13 17:55:34 user nova-compute[71354]:   <mtu size="1442"/>
Apr 13 17:55:34 user nova-compute[71354]:   <target dev="tap552a278f-c1"/>
Apr 13 17:55:34 user nova-compute[71354]: </interface>
Apr 13 17:55:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface> {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface>not found in domain: <domain type='kvm' id='28'>
Apr 13 17:55:34 user nova-compute[71354]:   <name>instance-00000016</name>
Apr 13 17:55:34 user nova-compute[71354]:   <uuid>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</uuid>
Apr 13 17:55:34 user nova-compute[71354]:   <metadata>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:34 user nova-compute[71354]:   <nova:package version="0.0.0"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:name>tempest-device-tagging-server-928673615</nova:name>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:creationTime>2023-04-13 17:55:20</nova:creationTime>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:flavor name="m1.nano">
Apr 13 17:55:34 user nova-compute[71354]:     <nova:memory>128</nova:memory>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:disk>1</nova:disk>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:swap>0</nova:swap>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:flavor>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:user uuid="c859ceec3df54c6ab1ae98a2c5320c2a">tempest-TaggedAttachmentsTest-1546533741-project-member</nova:user>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:project uuid="b120144ed4294837a716e156b12222e3">tempest-TaggedAttachmentsTest-1546533741</nova:project>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:ports>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:port uuid="274ea36d-e1f3-418a-9afa-173db904ef77">
Apr 13 17:55:34 user nova-compute[71354]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:55:34 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:port uuid="552a278f-c1f9-4704-b9d1-67b2d41328f0">
Apr 13 17:55:34 user nova-compute[71354]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Apr 13 17:55:34 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:ports>
Apr 13 17:55:34 user nova-compute[71354]: </nova:instance>
Apr 13 17:55:34 user nova-compute[71354]:   </metadata>
Apr 13 17:55:34 user nova-compute[71354]:   <memory unit='KiB'>131072</memory>
Apr 13 17:55:34 user nova-compute[71354]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 17:55:34 user nova-compute[71354]:   <vcpu placement='static'>1</vcpu>
Apr 13 17:55:34 user nova-compute[71354]:   <resource>
Apr 13 17:55:34 user nova-compute[71354]:     <partition>/machine</partition>
Apr 13 17:55:34 user nova-compute[71354]:   </resource>
Apr 13 17:55:34 user nova-compute[71354]:   <sysinfo type='smbios'>
Apr 13 17:55:34 user nova-compute[71354]:     <system>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='version'>0.0.0</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='serial'>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='uuid'>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='family'>Virtual Machine</entry>
Apr 13 17:55:34 user nova-compute[71354]:     </system>
Apr 13 17:55:34 user nova-compute[71354]:   </sysinfo>
Apr 13 17:55:34 user nova-compute[71354]:   <os>
Apr 13 17:55:34 user nova-compute[71354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 17:55:34 user nova-compute[71354]:     <boot dev='hd'/>
Apr 13 17:55:34 user nova-compute[71354]:     <smbios mode='sysinfo'/>
Apr 13 17:55:34 user nova-compute[71354]:   </os>
Apr 13 17:55:34 user nova-compute[71354]:   <features>
Apr 13 17:55:34 user nova-compute[71354]:     <acpi/>
Apr 13 17:55:34 user nova-compute[71354]:     <apic/>
Apr 13 17:55:34 user nova-compute[71354]:     <vmcoreinfo state='on'/>
Apr 13 17:55:34 user nova-compute[71354]:   </features>
Apr 13 17:55:34 user nova-compute[71354]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 17:55:34 user nova-compute[71354]:     <model fallback='forbid'>Nehalem</model>
Apr 13 17:55:34 user nova-compute[71354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='vme'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='x2apic'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='hypervisor'/>
Apr 13 17:55:34 user nova-compute[71354]:   </cpu>
Apr 13 17:55:34 user nova-compute[71354]:   <clock offset='utc'>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='hpet' present='no'/>
Apr 13 17:55:34 user nova-compute[71354]:   </clock>
Apr 13 17:55:34 user nova-compute[71354]:   <on_poweroff>destroy</on_poweroff>
Apr 13 17:55:34 user nova-compute[71354]:   <on_reboot>restart</on_reboot>
Apr 13 17:55:34 user nova-compute[71354]:   <on_crash>destroy</on_crash>
Apr 13 17:55:34 user nova-compute[71354]:   <devices>
Apr 13 17:55:34 user nova-compute[71354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 17:55:34 user nova-compute[71354]:     <disk type='file' device='disk'>
Apr 13 17:55:34 user nova-compute[71354]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 17:55:34 user nova-compute[71354]:       <source file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk' index='2'/>
Apr 13 17:55:34 user nova-compute[71354]:       <backingStore type='file' index='3'>
Apr 13 17:55:34 user nova-compute[71354]:         <format type='raw'/>
Apr 13 17:55:34 user nova-compute[71354]:         <source file='/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7'/>
Apr 13 17:55:34 user nova-compute[71354]:         <backingStore/>
Apr 13 17:55:34 user nova-compute[71354]:       </backingStore>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='vda' bus='virtio'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='virtio-disk0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </disk>
Apr 13 17:55:34 user nova-compute[71354]:     <disk type='file' device='cdrom'>
Apr 13 17:55:34 user nova-compute[71354]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 17:55:34 user nova-compute[71354]:       <source file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config' index='1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <backingStore/>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='hda' bus='ide'/>
Apr 13 17:55:34 user nova-compute[71354]:       <readonly/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='ide0-0-0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </disk>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='usb' index='0' model='none'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='usb'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='pci.0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='ide' index='0'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='ide'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <interface type='ethernet'>
Apr 13 17:55:34 user nova-compute[71354]:       <mac address='fa:16:3e:2b:9c:29'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='tap274ea36d-e1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <model type='virtio'/>
Apr 13 17:55:34 user nova-compute[71354]:       <mtu size='1442'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='net0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </interface>
Apr 13 17:55:34 user nova-compute[71354]:     <interface type='ethernet'>
Apr 13 17:55:34 user nova-compute[71354]:       <mac address='fa:16:3e:9d:23:8a'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='tap552a278f-c1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <model type='virtio'/>
Apr 13 17:55:34 user nova-compute[71354]:       <mtu size='1442'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='net1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </interface>
Apr 13 17:55:34 user nova-compute[71354]:     <serial type='pty'>
Apr 13 17:55:34 user nova-compute[71354]:       <source path='/dev/pts/4'/>
Apr 13 17:55:34 user nova-compute[71354]:       <log file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log' append='off'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target type='isa-serial' port='0'>
Apr 13 17:55:34 user nova-compute[71354]:         <model name='isa-serial'/>
Apr 13 17:55:34 user nova-compute[71354]:       </target>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='serial0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </serial>
Apr 13 17:55:34 user nova-compute[71354]:     <console type='pty' tty='/dev/pts/4'>
Apr 13 17:55:34 user nova-compute[71354]:       <source path='/dev/pts/4'/>
Apr 13 17:55:34 user nova-compute[71354]:       <log file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log' append='off'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target type='serial' port='0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='serial0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </console>
Apr 13 17:55:34 user nova-compute[71354]:     <input type='mouse' bus='ps2'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='input0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </input>
Apr 13 17:55:34 user nova-compute[71354]:     <input type='keyboard' bus='ps2'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='input1'/>
Apr 13 17:55:34 user nova-compute[71354]:     </input>
Apr 13 17:55:34 user nova-compute[71354]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 17:55:34 user nova-compute[71354]:       <listen type='address' address='0.0.0.0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </graphics>
Apr 13 17:55:34 user nova-compute[71354]:     <audio id='1' type='none'/>
Apr 13 17:55:34 user nova-compute[71354]:     <video>
Apr 13 17:55:34 user nova-compute[71354]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='video0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </video>
Apr 13 17:55:34 user nova-compute[71354]:     <memballoon model='virtio'>
Apr 13 17:55:34 user nova-compute[71354]:       <stats period='10'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='balloon0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </memballoon>
Apr 13 17:55:34 user nova-compute[71354]:     <rng model='virtio'>
Apr 13 17:55:34 user nova-compute[71354]:       <backend model='random'>/dev/urandom</backend>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='rng0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </rng>
Apr 13 17:55:34 user nova-compute[71354]:   </devices>
Apr 13 17:55:34 user nova-compute[71354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 17:55:34 user nova-compute[71354]:     <label>libvirt-d0042ccb-5c99-4880-8ec4-3a3c54769d6d</label>
Apr 13 17:55:34 user nova-compute[71354]:     <imagelabel>libvirt-d0042ccb-5c99-4880-8ec4-3a3c54769d6d</imagelabel>
Apr 13 17:55:34 user nova-compute[71354]:   </seclabel>
Apr 13 17:55:34 user nova-compute[71354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 17:55:34 user nova-compute[71354]:     <label>+64055:+108</label>
Apr 13 17:55:34 user nova-compute[71354]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 17:55:34 user nova-compute[71354]:   </seclabel>
Apr 13 17:55:34 user nova-compute[71354]: </domain>
Apr 13 17:55:34 user nova-compute[71354]:  {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 17:55:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully detached device tap552a278f-c1 from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the persistent domain config.
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] (1/8): Attempting to detach device tap552a278f-c1 with device alias net1 from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] detach device xml: <interface type="ethernet">
Apr 13 17:55:34 user nova-compute[71354]:   <mac address="fa:16:3e:9d:23:8a"/>
Apr 13 17:55:34 user nova-compute[71354]:   <model type="virtio"/>
Apr 13 17:55:34 user nova-compute[71354]:   <mtu size="1442"/>
Apr 13 17:55:34 user nova-compute[71354]:   <target dev="tap552a278f-c1"/>
Apr 13 17:55:34 user nova-compute[71354]: </interface>
Apr 13 17:55:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.neutron [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updated VIF entry in instance network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.neutron [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408534.5133195, d0042ccb-5c99-4880-8ec4-3a3c54769d6d => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Start waiting for the detach event from libvirt for device tap552a278f-c1 with device alias net1 for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface> {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:23:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tap552a278f-c1"/></interface>not found in domain: <domain type='kvm' id='28'>
Apr 13 17:55:34 user nova-compute[71354]:   <name>instance-00000016</name>
Apr 13 17:55:34 user nova-compute[71354]:   <uuid>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</uuid>
Apr 13 17:55:34 user nova-compute[71354]:   <metadata>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:34 user nova-compute[71354]:   <nova:package version="0.0.0"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:name>tempest-device-tagging-server-928673615</nova:name>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:creationTime>2023-04-13 17:55:20</nova:creationTime>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:flavor name="m1.nano">
Apr 13 17:55:34 user nova-compute[71354]:     <nova:memory>128</nova:memory>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:disk>1</nova:disk>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:swap>0</nova:swap>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:flavor>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:user uuid="c859ceec3df54c6ab1ae98a2c5320c2a">tempest-TaggedAttachmentsTest-1546533741-project-member</nova:user>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:project uuid="b120144ed4294837a716e156b12222e3">tempest-TaggedAttachmentsTest-1546533741</nova:project>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:ports>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:port uuid="274ea36d-e1f3-418a-9afa-173db904ef77">
Apr 13 17:55:34 user nova-compute[71354]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:55:34 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:port uuid="552a278f-c1f9-4704-b9d1-67b2d41328f0">
Apr 13 17:55:34 user nova-compute[71354]:       <nova:ip type="fixed" address="10.10.10.87" ipVersion="4"/>
Apr 13 17:55:34 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:ports>
Apr 13 17:55:34 user nova-compute[71354]: </nova:instance>
Apr 13 17:55:34 user nova-compute[71354]:   </metadata>
Apr 13 17:55:34 user nova-compute[71354]:   <memory unit='KiB'>131072</memory>
Apr 13 17:55:34 user nova-compute[71354]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 17:55:34 user nova-compute[71354]:   <vcpu placement='static'>1</vcpu>
Apr 13 17:55:34 user nova-compute[71354]:   <resource>
Apr 13 17:55:34 user nova-compute[71354]:     <partition>/machine</partition>
Apr 13 17:55:34 user nova-compute[71354]:   </resource>
Apr 13 17:55:34 user nova-compute[71354]:   <sysinfo type='smbios'>
Apr 13 17:55:34 user nova-compute[71354]:     <system>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='version'>0.0.0</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='serial'>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='uuid'>d0042ccb-5c99-4880-8ec4-3a3c54769d6d</entry>
Apr 13 17:55:34 user nova-compute[71354]:       <entry name='family'>Virtual Machine</entry>
Apr 13 17:55:34 user nova-compute[71354]:     </system>
Apr 13 17:55:34 user nova-compute[71354]:   </sysinfo>
Apr 13 17:55:34 user nova-compute[71354]:   <os>
Apr 13 17:55:34 user nova-compute[71354]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 17:55:34 user nova-compute[71354]:     <boot dev='hd'/>
Apr 13 17:55:34 user nova-compute[71354]:     <smbios mode='sysinfo'/>
Apr 13 17:55:34 user nova-compute[71354]:   </os>
Apr 13 17:55:34 user nova-compute[71354]:   <features>
Apr 13 17:55:34 user nova-compute[71354]:     <acpi/>
Apr 13 17:55:34 user nova-compute[71354]:     <apic/>
Apr 13 17:55:34 user nova-compute[71354]:     <vmcoreinfo state='on'/>
Apr 13 17:55:34 user nova-compute[71354]:   </features>
Apr 13 17:55:34 user nova-compute[71354]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 17:55:34 user nova-compute[71354]:     <model fallback='forbid'>Nehalem</model>
Apr 13 17:55:34 user nova-compute[71354]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='vme'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='x2apic'/>
Apr 13 17:55:34 user nova-compute[71354]:     <feature policy='require' name='hypervisor'/>
Apr 13 17:55:34 user nova-compute[71354]:   </cpu>
Apr 13 17:55:34 user nova-compute[71354]:   <clock offset='utc'>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 17:55:34 user nova-compute[71354]:     <timer name='hpet' present='no'/>
Apr 13 17:55:34 user nova-compute[71354]:   </clock>
Apr 13 17:55:34 user nova-compute[71354]:   <on_poweroff>destroy</on_poweroff>
Apr 13 17:55:34 user nova-compute[71354]:   <on_reboot>restart</on_reboot>
Apr 13 17:55:34 user nova-compute[71354]:   <on_crash>destroy</on_crash>
Apr 13 17:55:34 user nova-compute[71354]:   <devices>
Apr 13 17:55:34 user nova-compute[71354]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 17:55:34 user nova-compute[71354]:     <disk type='file' device='disk'>
Apr 13 17:55:34 user nova-compute[71354]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 17:55:34 user nova-compute[71354]:       <source file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk' index='2'/>
Apr 13 17:55:34 user nova-compute[71354]:       <backingStore type='file' index='3'>
Apr 13 17:55:34 user nova-compute[71354]:         <format type='raw'/>
Apr 13 17:55:34 user nova-compute[71354]:         <source file='/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7'/>
Apr 13 17:55:34 user nova-compute[71354]:         <backingStore/>
Apr 13 17:55:34 user nova-compute[71354]:       </backingStore>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='vda' bus='virtio'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='virtio-disk0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </disk>
Apr 13 17:55:34 user nova-compute[71354]:     <disk type='file' device='cdrom'>
Apr 13 17:55:34 user nova-compute[71354]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 17:55:34 user nova-compute[71354]:       <source file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk.config' index='1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <backingStore/>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='hda' bus='ide'/>
Apr 13 17:55:34 user nova-compute[71354]:       <readonly/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='ide0-0-0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </disk>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='usb' index='0' model='none'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='usb'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='pci.0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <controller type='ide' index='0'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='ide'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 17:55:34 user nova-compute[71354]:     </controller>
Apr 13 17:55:34 user nova-compute[71354]:     <interface type='ethernet'>
Apr 13 17:55:34 user nova-compute[71354]:       <mac address='fa:16:3e:2b:9c:29'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target dev='tap274ea36d-e1'/>
Apr 13 17:55:34 user nova-compute[71354]:       <model type='virtio'/>
Apr 13 17:55:34 user nova-compute[71354]:       <mtu size='1442'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='net0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </interface>
Apr 13 17:55:34 user nova-compute[71354]:     <serial type='pty'>
Apr 13 17:55:34 user nova-compute[71354]:       <source path='/dev/pts/4'/>
Apr 13 17:55:34 user nova-compute[71354]:       <log file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log' append='off'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target type='isa-serial' port='0'>
Apr 13 17:55:34 user nova-compute[71354]:         <model name='isa-serial'/>
Apr 13 17:55:34 user nova-compute[71354]:       </target>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='serial0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </serial>
Apr 13 17:55:34 user nova-compute[71354]:     <console type='pty' tty='/dev/pts/4'>
Apr 13 17:55:34 user nova-compute[71354]:       <source path='/dev/pts/4'/>
Apr 13 17:55:34 user nova-compute[71354]:       <log file='/opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/console.log' append='off'/>
Apr 13 17:55:34 user nova-compute[71354]:       <target type='serial' port='0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='serial0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </console>
Apr 13 17:55:34 user nova-compute[71354]:     <input type='mouse' bus='ps2'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='input0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </input>
Apr 13 17:55:34 user nova-compute[71354]:     <input type='keyboard' bus='ps2'>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='input1'/>
Apr 13 17:55:34 user nova-compute[71354]:     </input>
Apr 13 17:55:34 user nova-compute[71354]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 17:55:34 user nova-compute[71354]:       <listen type='address' address='0.0.0.0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </graphics>
Apr 13 17:55:34 user nova-compute[71354]:     <audio id='1' type='none'/>
Apr 13 17:55:34 user nova-compute[71354]:     <video>
Apr 13 17:55:34 user nova-compute[71354]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='video0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </video>
Apr 13 17:55:34 user nova-compute[71354]:     <memballoon model='virtio'>
Apr 13 17:55:34 user nova-compute[71354]:       <stats period='10'/>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='balloon0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </memballoon>
Apr 13 17:55:34 user nova-compute[71354]:     <rng model='virtio'>
Apr 13 17:55:34 user nova-compute[71354]:       <backend model='random'>/dev/urandom</backend>
Apr 13 17:55:34 user nova-compute[71354]:       <alias name='rng0'/>
Apr 13 17:55:34 user nova-compute[71354]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 17:55:34 user nova-compute[71354]:     </rng>
Apr 13 17:55:34 user nova-compute[71354]:   </devices>
Apr 13 17:55:34 user nova-compute[71354]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 17:55:34 user nova-compute[71354]:     <label>libvirt-d0042ccb-5c99-4880-8ec4-3a3c54769d6d</label>
Apr 13 17:55:34 user nova-compute[71354]:     <imagelabel>libvirt-d0042ccb-5c99-4880-8ec4-3a3c54769d6d</imagelabel>
Apr 13 17:55:34 user nova-compute[71354]:   </seclabel>
Apr 13 17:55:34 user nova-compute[71354]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 17:55:34 user nova-compute[71354]:     <label>+64055:+108</label>
Apr 13 17:55:34 user nova-compute[71354]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 17:55:34 user nova-compute[71354]:   </seclabel>
Apr 13 17:55:34 user nova-compute[71354]: </domain>
Apr 13 17:55:34 user nova-compute[71354]:  {{(pid=71354) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 17:55:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully detached device tap552a278f-c1 from instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d from the live domain config.
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "address": "fa:16:3e:9d:23:8a", "network": {"id": "d4a67e65-2220-490b-b34d-0e75023b0b44", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-833109506", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap552a278f-c1", "ovs_interfaceid": "552a278f-c1f9-4704-b9d1-67b2d41328f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG os_vif [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96d990b4-59dc-44f4-8005-e6c0f37f7742 req-95880d46-78c6-47d4-a4ab-14db10d36e5b service nova] Releasing lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap552a278f-c1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: INFO os_vif [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:23:8a,bridge_name='br-int',has_traffic_filtering=True,id=552a278f-c1f9-4704-b9d1-67b2d41328f0,network=Network(d4a67e65-2220-490b-b34d-0e75023b0b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap552a278f-c1')
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:55:34 user nova-compute[71354]:   <nova:package version="0.0.0"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:name>tempest-device-tagging-server-928673615</nova:name>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:creationTime>2023-04-13 17:55:34</nova:creationTime>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:flavor name="m1.nano">
Apr 13 17:55:34 user nova-compute[71354]:     <nova:memory>128</nova:memory>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:disk>1</nova:disk>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:swap>0</nova:swap>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:vcpus>1</nova:vcpus>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:flavor>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:user uuid="c859ceec3df54c6ab1ae98a2c5320c2a">tempest-TaggedAttachmentsTest-1546533741-project-member</nova:user>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:project uuid="b120144ed4294837a716e156b12222e3">tempest-TaggedAttachmentsTest-1546533741</nova:project>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:owner>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:55:34 user nova-compute[71354]:   <nova:ports>
Apr 13 17:55:34 user nova-compute[71354]:     <nova:port uuid="274ea36d-e1f3-418a-9afa-173db904ef77">
Apr 13 17:55:34 user nova-compute[71354]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:55:34 user nova-compute[71354]:     </nova:port>
Apr 13 17:55:34 user nova-compute[71354]:   </nova:ports>
Apr 13 17:55:34 user nova-compute[71354]: </nova:instance>
Apr 13 17:55:34 user nova-compute[71354]:  {{(pid=71354) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing instance network info cache due to event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:34 user nova-compute[71354]: DEBUG nova.network.neutron [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-unplugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-unplugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:35 user nova-compute[71354]: WARNING nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-unplugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance with vm_state active and task_state None.
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:35 user nova-compute[71354]: WARNING nova.compute.manager [req-23879203-f5b2-4c05-a87f-79b4e90c7c99 req-90f024b0-da01-4f42-b67b-e6b22ffc5606 service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-552a278f-c1f9-4704-b9d1-67b2d41328f0 for instance with vm_state active and task_state None.
Apr 13 17:55:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:35 user nova-compute[71354]: INFO nova.compute.manager [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Rebooting instance
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquired lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updated VIF entry in instance network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8540a392-60aa-4d2d-b42b-9bfa5cf1df48 req-2870afc0-9996-4c2c-9806-d392766827c2 service nova] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:36 user nova-compute[71354]: INFO nova.network.neutron [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Port 552a278f-c1f9-4704-b9d1-67b2d41328f0 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [{"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Releasing lock "refresh_cache-d0042ccb-5c99-4880-8ec4-3a3c54769d6d" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] No waiting events found dispatching network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:36 user nova-compute[71354]: WARNING nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received unexpected event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f for instance with vm_state building and task_state spawning.
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] No waiting events found dispatching network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:36 user nova-compute[71354]: WARNING nova.compute.manager [req-8584f759-3d3b-40cf-9569-b2e9172f84f0 req-8dbfc0cd-7a0f-495a-ab28-3bbe3d65c705 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received unexpected event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f for instance with vm_state building and task_state spawning.
Apr 13 17:55:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-01c307e0-792c-4cd9-8f97-3a7a91607ce3 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "interface-d0042ccb-5c99-4880-8ec4-3a3c54769d6d-552a278f-c1f9-4704-b9d1-67b2d41328f0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.783s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-039c2728-d7ba-48e8-a66d-6d582e7ed6ae req-797b6849-ba12-41b9-b3d9-b48e68d514fc service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-deleted-552a278f-c1f9-4704-b9d1-67b2d41328f0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408537.7518833, 9851b648-0b93-441b-9912-2216b528d030 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] VM Resumed (Lifecycle Event)
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] Instance spawned successfully.
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408537.753181, 9851b648-0b93-441b-9912-2216b528d030 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] VM Started (Lifecycle Event)
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Took 8.59 seconds to spawn the instance on the hypervisor.
Apr 13 17:55:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:37 user nova-compute[71354]: INFO nova.compute.manager [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Took 9.55 seconds to build instance.
Apr 13 17:55:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c8e91330-d34d-4f55-aa17-668b79af623a tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.659s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:40 user nova-compute[71354]: WARNING nova.compute.manager [req-2c00f7f8-d934-4a02-b725-30a2761c0f59 req-40d72242-f28c-49c3-b490-703205625bc5 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state active and task_state reboot_started.
Apr 13 17:55:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance shutdown successfully.
Apr 13 17:55:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:42 user nova-compute[71354]: WARNING nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state active and task_state reboot_started.
Apr 13 17:55:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:42 user nova-compute[71354]: WARNING nova.compute.manager [req-25528702-7bfd-4b52-b9c3-aebceedfd2e1 req-9b8d5bed-89fb-4b0f-bf98-38dfa7c798ad service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state active and task_state reboot_started.
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 37a22063-cedb-45b0-8554-b1e60a7d4324 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:55:43 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408543.99277, 37a22063-cedb-45b0-8554-b1e60a7d4324 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:43 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] VM Resumed (Lifecycle Event)
Apr 13 17:55:44 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance running successfully.
Apr 13 17:55:44 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance soft rebooted successfully.
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:44 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408543.9942005, 37a22063-cedb-45b0-8554-b1e60a7d4324 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:55:44 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] VM Started (Lifecycle Event)
Apr 13 17:55:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c1f6332-cbf4-48bb-9b6f-9212f48fb537 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.559s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:55:44 user nova-compute[71354]: WARNING nova.compute.manager [req-f12b64d9-dca9-49fc-aabe-83172300bf80 req-1c784466-b57c-428d-afd5-2786975742d7 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state active and task_state None.
Apr 13 17:55:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:55:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:47 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:55 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:55 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=26.167888641357422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Applying migration context for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 as it has an incoming, in-progress migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619. Migration status is finished {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 17:55:55 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating resource usage from migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:55:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:55:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:55:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:55:56 user nova-compute[71354]: INFO nova.compute.manager [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Detaching volume 841bd7fe-de3a-41ad-b1c2-1e46cf6645e8
Apr 13 17:55:56 user nova-compute[71354]: INFO nova.virt.block_device [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Attempting to driver detach volume 841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 from mountpoint /dev/vdc
Apr 13 17:55:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Attempting to detach device vdc from instance 1753314b-bfd7-4e8b-986b-0253666ab8aa from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:55:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:55:56 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:56 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:55:56 user nova-compute[71354]:   <target dev="vdc" bus="virtio"/>
Apr 13 17:55:56 user nova-compute[71354]:   <serial>841bd7fe-de3a-41ad-b1c2-1e46cf6645e8</serial>
Apr 13 17:55:56 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:55:56 user nova-compute[71354]: </disk>
Apr 13 17:55:56 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully detached device vdc from instance 1753314b-bfd7-4e8b-986b-0253666ab8aa from the persistent domain config.
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1753314b-bfd7-4e8b-986b-0253666ab8aa from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:55:57 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:55:57 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:55:57 user nova-compute[71354]:   <target dev="vdc" bus="virtio"/>
Apr 13 17:55:57 user nova-compute[71354]:   <serial>841bd7fe-de3a-41ad-b1c2-1e46cf6645e8</serial>
Apr 13 17:55:57 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 17:55:57 user nova-compute[71354]: </disk>
Apr 13 17:55:57 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408557.5926652, 1753314b-bfd7-4e8b-986b-0253666ab8aa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:55:57 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully detached device vdc from instance 1753314b-bfd7-4e8b-986b-0253666ab8aa from the live domain config.
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMYLivXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:55:57 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d3f2b-1f43-42b4-904a-1aa32635ad33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:55:57 user nova-compute[71354]: No targets found.
Apr 13 17:55:57 user nova-compute[71354]: iSNS:
Apr 13 17:55:57 user nova-compute[71354]: No targets found.
Apr 13 17:55:57 user nova-compute[71354]: STATIC:
Apr 13 17:55:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:55:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:55:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:55:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:55:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:57 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8
Apr 13 17:55:57 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:55:57 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:55:57 user nova-compute[71354]: FIRMWARE:
Apr 13 17:55:57 user nova-compute[71354]: No targets found.
Apr 13 17:55:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:55:57 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:55:57 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ddf78-f132-4c3d-93f1-1303159697dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb33c97f-981a-4967-aa2e-4913e4adbb45]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:55:57 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:55:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d466fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3245c191-e402-4e88-88e9-971be68fc79f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[342540ef-f8da-4ffe-a7e8-d63adc62fb22]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1ca6f1-459e-46dd-a4a6-44f36c8c61d0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc56506-50d0-4e2c-aa62-4d8ee488aa92]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97265bf-ab09-4404-bd20-d93b4fdc9154]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[85671e6c-8552-47ca-8159-35cc64a9af28]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260]
Apr 13 17:55:57 user nova-compute[71354]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8, portal: 172.16.0.220,3260] successful.
Apr 13 17:55:57 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841bd7fe-de3a-41ad-b1c2-1e46cf6645e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b5026-1559-435d-bbb5-cdea3e3771b0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] <== disconnect_volume: return (366ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:55:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'flavor' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:55:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89090df5-9807-4489-8751-a4ee134f2a99 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.048s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:21 user nova-compute[71354]: INFO nova.compute.manager [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Unrescuing
Apr 13 17:56:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG nova.objects.instance [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'flavor' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:22 user nova-compute[71354]: WARNING nova.compute.manager [req-baf96a3c-2cef-4f9b-8cda-ad2387f4df85 req-e605976b-5399-4e62-8ac2-37733a228aec service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance destroyed successfully.
Apr 13 17:56:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:24 user nova-compute[71354]: WARNING nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:24 user nova-compute[71354]: WARNING nova.compute.manager [req-af135504-5af8-41f8-bb2a-69a2c1943be9 req-76b8ef87-04ea-4664-ac1a-6da05b893dd5 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:24 user nova-compute[71354]: INFO nova.compute.manager [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Terminating instance
Apr 13 17:56:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:56:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-unplugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-unplugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-3881fc9c-6bfc-4ecb-a92e-a9a0be67bd7e req-0401cd5d-3a2e-4384-9f77-3b10eb56eccc service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-unplugged-274ea36d-e1f3-418a-9afa-173db904ef77 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:56:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Instance destroyed successfully.
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lazy-loading 'resources' on Instance uuid d0042ccb-5c99-4880-8ec4-3a3c54769d6d {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-928673615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-928673615',id=22,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnXDVHfTRBpUYlfAprk3mH31AF7eAqIbu95MlzLdOPYk1JsNbgVz6Q8uk8avvttZwx/1EKAYyctcuQvsAVcd0JmpEuj9BDolmd+t4kHEuS8yvx4inVgSe5ePvBOsuhIZg==',key_name='tempest-keypair-524527809',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b120144ed4294837a716e156b12222e3',ramdisk_id='',reservation_id='r-4tpb0bdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1546533741',owner_user_name='tempest-TaggedAttachmentsTest-1546533741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c859ceec3df54c6ab1ae98a2c5320c2a',uuid=d0042ccb-5c99-4880-8ec4-3a3c54769d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converting VIF {"id": "274ea36d-e1f3-418a-9afa-173db904ef77", "address": "fa:16:3e:2b:9c:29", "network": {"id": "465a1bd9-320e-482e-823c-9caf66903d60", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1552002283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b120144ed4294837a716e156b12222e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274ea36d-e1", "ovs_interfaceid": "274ea36d-e1f3-418a-9afa-173db904ef77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG os_vif [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap274ea36d-e1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:25 user nova-compute[71354]: INFO os_vif [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9c:29,bridge_name='br-int',has_traffic_filtering=True,id=274ea36d-e1f3-418a-9afa-173db904ef77,network=Network(465a1bd9-320e-482e-823c-9caf66903d60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274ea36d-e1')
Apr 13 17:56:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Deleting instance files /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d_del
Apr 13 17:56:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Deletion of /opt/stack/data/nova/instances/d0042ccb-5c99-4880-8ec4-3a3c54769d6d_del complete
Apr 13 17:56:25 user nova-compute[71354]: INFO nova.compute.manager [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 17:56:25 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:56:25 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 1774abdc-69cc-4755-b62a-c74bc1997944 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408586.0446262, 1774abdc-69cc-4755-b62a-c74bc1997944 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Resumed (Lifecycle Event)
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-eade779b-d647-419a-9e60-a0183d7d841f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408586.0467284, 1774abdc-69cc-4755-b62a-c74bc1997944 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Started (Lifecycle Event)
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:26 user nova-compute[71354]: WARNING nova.compute.manager [req-8434a5ad-ccad-4e61-8194-2719cd449356 req-23169a81-8161-4a84-bc37-892819466fdf service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state None.
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:26 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Took 0.79 seconds to deallocate network for instance.
Apr 13 17:56:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:26 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:27 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Deleted allocations for instance d0042ccb-5c99-4880-8ec4-3a3c54769d6d
Apr 13 17:56:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0b869a14-fbc1-4cac-a6bd-84df942de531 tempest-TaggedAttachmentsTest-1546533741 tempest-TaggedAttachmentsTest-1546533741-project-member] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Acquiring lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] Lock "d0042ccb-5c99-4880-8ec4-3a3c54769d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] No waiting events found dispatching network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:27 user nova-compute[71354]: WARNING nova.compute.manager [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received unexpected event network-vif-plugged-274ea36d-e1f3-418a-9afa-173db904ef77 for instance with vm_state deleted and task_state None.
Apr 13 17:56:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c051ce2a-525e-45ef-9d32-1abebcce9b36 req-20747749-df80-4f3b-a9d0-c419d3cf304d service nova] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Received event network-vif-deleted-274ea36d-e1f3-418a-9afa-173db904ef77 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Port 067fbe09-ace1-4188-a99f-ee4847a1a311 binding to destination host user is already ACTIVE {{(pid=71354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Creating tmpfile /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/tmpnmq4le8b to verify with other compute node that the instance is on the same shared storage. {{(pid=71354) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:40 user nova-compute[71354]: WARNING nova.compute.manager [req-79968ac5-9454-47ad-a671-233f1a7e52b9 req-d8d92a9d-e093-418e-8e35-e807bfa96238 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state resized and task_state resize_reverting.
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquired lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'info_cache' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408585.6796484, d0042ccb-5c99-4880-8ec4-3a3c54769d6d => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:40 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] VM Stopped (Lifecycle Event)
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7f0c5a37-51f5-471c-9f8c-fa50a39907a2 None None] [instance: d0042ccb-5c99-4880-8ec4-3a3c54769d6d] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance destroyed successfully.
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:55:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067fbe09-ac, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:40 user nova-compute[71354]: INFO os_vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:56:40 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a2e7c-8f14-4b6c-98eb-5d21639bbd5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:56:40 user nova-compute[71354]: No targets found.
Apr 13 17:56:40 user nova-compute[71354]: iSNS:
Apr 13 17:56:40 user nova-compute[71354]: No targets found.
Apr 13 17:56:40 user nova-compute[71354]: STATIC:
Apr 13 17:56:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:56:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:56:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:56:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:56:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:56:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:56:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:56:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:56:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:56:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:56:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:56:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:56:40 user nova-compute[71354]: FIRMWARE:
Apr 13 17:56:40 user nova-compute[71354]: No targets found.
Apr 13 17:56:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:56:40 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:56:40 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c293ea7-daaa-448d-bfbf-490a195e17d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d50b77-2f74-47c5-ab66-30ec126d5622]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:40 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc304430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb81b0-7751-471d-ba63-778d8f3f18bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0108cb3e-5202-490a-93e0-59f8be6efe74]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG nova.network.neutron [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[23994414-75cc-4dfc-9ce9-c2358f117cbe]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Releasing lock "refresh_cache-bcfd107b-fef8-4acf-9a2c-1861aabacfe9" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance destroyed successfully.
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'resources' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6939f941-8c11-453d-99d3-1d4fad9d1a70]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap723c0bf0-b7, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: INFO os_vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dda4ec-6ec5-4fe3-8f11-db63a2a1898d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start _get_guest_xml network_info=[{"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'numa_topology' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:41 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'pci_devices' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c540b1d4-d858-496d-891d-3650f5f7f337]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:56:41 user nova-compute[71354]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:56:41 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:56:41 user nova-compute[71354]:   <uuid>bcfd107b-fef8-4acf-9a2c-1861aabacfe9</uuid>
Apr 13 17:56:41 user nova-compute[71354]:   <name>instance-0000000d</name>
Apr 13 17:56:41 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:56:41 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:56:41 user nova-compute[71354]:   <metadata>
Apr 13 17:56:41 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:56:41 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeTestJSON-server-1433621576</nova:name>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:56:41</nova:creationTime>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:56:41 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:56:41 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:owner>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:user uuid="91769944ac8048dbb1f418d232e670d3">tempest-AttachVolumeTestJSON-2087525588-project-member</nova:user>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:project uuid="5ee8ad9e1bc74eb9b9997f7706d3f096">tempest-AttachVolumeTestJSON-2087525588</nova:project>
Apr 13 17:56:41 user nova-compute[71354]:       </nova:owner>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:56:41 user nova-compute[71354]:       <nova:ports>
Apr 13 17:56:41 user nova-compute[71354]:         <nova:port uuid="723c0bf0-b727-4ff6-b9fe-2197b7609fa0">
Apr 13 17:56:41 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:56:41 user nova-compute[71354]:         </nova:port>
Apr 13 17:56:41 user nova-compute[71354]:       </nova:ports>
Apr 13 17:56:41 user nova-compute[71354]:     </nova:instance>
Apr 13 17:56:41 user nova-compute[71354]:   </metadata>
Apr 13 17:56:41 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:56:41 user nova-compute[71354]:     <system>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="serial">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="uuid">bcfd107b-fef8-4acf-9a2c-1861aabacfe9</entry>
Apr 13 17:56:41 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:56:41 user nova-compute[71354]:     </system>
Apr 13 17:56:41 user nova-compute[71354]:   </sysinfo>
Apr 13 17:56:41 user nova-compute[71354]:   <os>
Apr 13 17:56:41 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:56:41 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:56:41 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:56:41 user nova-compute[71354]:   </os>
Apr 13 17:56:41 user nova-compute[71354]:   <features>
Apr 13 17:56:41 user nova-compute[71354]:     <acpi/>
Apr 13 17:56:41 user nova-compute[71354]:     <apic/>
Apr 13 17:56:41 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:56:41 user nova-compute[71354]:   </features>
Apr 13 17:56:41 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:56:41 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:56:41 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:56:41 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:56:41 user nova-compute[71354]:   </clock>
Apr 13 17:56:41 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:56:41 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:56:41 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:56:41 user nova-compute[71354]:   </cpu>
Apr 13 17:56:41 user nova-compute[71354]:   <devices>
Apr 13 17:56:41 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:56:41 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:56:41 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk"/>
Apr 13 17:56:41 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:56:41 user nova-compute[71354]:     </disk>
Apr 13 17:56:41 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:56:41 user nova-compute[71354]:       <mac address="fa:16:3e:9b:e2:8a"/>
Apr 13 17:56:41 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:56:41 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:56:41 user nova-compute[71354]:       <target dev="tap723c0bf0-b7"/>
Apr 13 17:56:41 user nova-compute[71354]:     </interface>
Apr 13 17:56:41 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:56:41 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/console.log" append="off"/>
Apr 13 17:56:41 user nova-compute[71354]:     </serial>
Apr 13 17:56:41 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:56:41 user nova-compute[71354]:     <video>
Apr 13 17:56:41 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:56:41 user nova-compute[71354]:     </video>
Apr 13 17:56:41 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:56:41 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:56:41 user nova-compute[71354]:     </rng>
Apr 13 17:56:41 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:56:41 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:56:41 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:56:41 user nova-compute[71354]:     </memballoon>
Apr 13 17:56:41 user nova-compute[71354]:   </devices>
Apr 13 17:56:41 user nova-compute[71354]: </domain>
Apr 13 17:56:41 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa56a9b-9789-4005-924f-844bb5662071]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (372ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Cannot resize image /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'migration_context' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG os_vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap723c0bf0-b7, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap723c0bf0-b7, col_values=(('external_ids', {'iface-id': '723c0bf0-b727-4ff6-b9fe-2197b7609fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:e2:8a', 'vm-uuid': 'bcfd107b-fef8-4acf-9a2c-1861aabacfe9'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:56:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:41 user nova-compute[71354]: INFO os_vif [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:56:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:42 user nova-compute[71354]: WARNING nova.compute.manager [req-cbdfb3bd-2b93-4bd0-bc7c-400f0dfced1c req-c1191b31-1172-406b-b93b-e55f8ba2ee2b service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state resized and task_state resize_reverting.
Apr 13 17:56:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'migration_context' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:56:42 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.463s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: INFO nova.compute.manager [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Swapping old allocation on dict_keys(['5ba64940-f5e9-4512-be6b-2626ffa78506']) held by migration 296dd8bb-4aea-4e03-b4fd-3bfe9f5a1619 for instance
Apr 13 17:56:43 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Overwriting current allocation {'allocations': {'5ba64940-f5e9-4512-be6b-2626ffa78506': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 29}}, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'user_id': '8f796555c0e242d091502725ec595c0f', 'consumer_generation': 1} on consumer 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:43 user nova-compute[71354]: WARNING nova.compute.manager [req-8c14b035-6020-4c97-9022-dd168532bb01 req-6ef4abc1-b714-49ab-af88-c6ca39b51660 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state powering-on.
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-08984ef0-6db9-4a60-b5b9-a6325ec531b1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.utils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca722c0c-13fd-4887-a489-f22b392056d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c89e4-7535-4c95-8982-48f5f3f8192b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b3ef3-2984-4217-8982-523651581ff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6800b055-ceec-426e-940d-f1f9a2226bc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:56:44 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:56:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25edce-7912-4547-b728-e3b4753203fb]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:56:44 user nova-compute[71354]: DEBUG os_brick.utils [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:56:45 user nova-compute[71354]: INFO nova.compute.manager [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Unrescuing
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408605.4081109, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:45 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Resumed (Lifecycle Event)
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:45 user nova-compute[71354]: WARNING nova.compute.manager [req-a5e9117e-5ae8-48f1-8fac-94a53b279e12 req-742ed70f-07a7-4e7b-9313-503261bce383 service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state stopped and task_state powering-on.
Apr 13 17:56:45 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance rebooted successfully.
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e99f8438-4391-4fb9-a60f-f9cffc9ded1a tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:45 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408605.4087274, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:45 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Started (Lifecycle Event)
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:46 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance destroyed successfully.
Apr 13 17:56:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:47 user nova-compute[71354]: INFO nova.compute.manager [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Terminating instance
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:47 user nova-compute[71354]: WARNING nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:47 user nova-compute[71354]: WARNING nova.compute.manager [req-054fc80f-68e7-4b2c-a45e-568a36fb2679 req-36dd4036-368a-47e3-98a5-d0f5d9417e4f service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-0f14f881-aab4-4587-88ed-0639a33355ed req-b826a7f0-0d02-41d3-b6d7-2e1ccbd99a2e service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-unplugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Instance destroyed successfully.
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.objects.instance [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'resources' on Instance uuid 1753314b-bfd7-4e8b-986b-0253666ab8aa {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1379597542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1379597542',id=18,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqZOy7olKGfFEjGGEPUTWiwXJI6g8Pqj8VfYP7qUXA0qO+ggL6RxnieeiumVfVpIKABKlrT7FLRvV7y281BJMwrmjY6lnjk387cGRy7pkcY03EjqW+oukCEfTzjIpGsQ==',key_name='tempest-keypair-142800183',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:54:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-d17cut61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=1753314b-bfd7-4e8b-986b-0253666ab8aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "72193ca5-011d-4cf8-b016-194d83952281", "address": "fa:16:3e:9b:5a:72", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72193ca5-01", "ovs_interfaceid": "72193ca5-011d-4cf8-b016-194d83952281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG os_vif [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72193ca5-01, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:48 user nova-compute[71354]: INFO os_vif [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5a:72,bridge_name='br-int',has_traffic_filtering=True,id=72193ca5-011d-4cf8-b016-194d83952281,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72193ca5-01')
Apr 13 17:56:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Deleting instance files /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa_del
Apr 13 17:56:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Deletion of /opt/stack/data/nova/instances/1753314b-bfd7-4e8b-986b-0253666ab8aa_del complete
Apr 13 17:56:48 user nova-compute[71354]: INFO nova.compute.manager [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 13 17:56:48 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:49 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Took 0.76 seconds to deallocate network for instance.
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-deleted-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:49 user nova-compute[71354]: INFO nova.compute.manager [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Neutron deleted interface 72193ca5-011d-4cf8-b016-194d83952281; detaching it from the instance and deleting it from the info cache
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.network.neutron [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0d0323b-059a-4901-88e6-788cbe2a350a req-6560248c-d3ac-494c-a780-35878f609d90 service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Detach interface failed, port_id=72193ca5-011d-4cf8-b016-194d83952281, reason: Instance 1753314b-bfd7-4e8b-986b-0253666ab8aa could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:49 user nova-compute[71354]: WARNING nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:49 user nova-compute[71354]: WARNING nova.compute.manager [req-9f375db2-6bcf-4477-bd1f-415ff40dce52 req-a405557d-49ea-4185-ab0c-d0983046fc28 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state rescued and task_state unrescuing.
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:49 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Deleted allocations for instance 1753314b-bfd7-4e8b-986b-0253666ab8aa
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-16836964-e14e-4637-8973-0db90eee80c6 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Acquiring lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] Lock "1753314b-bfd7-4e8b-986b-0253666ab8aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] No waiting events found dispatching network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:49 user nova-compute[71354]: WARNING nova.compute.manager [req-e961aa4f-c654-4f3a-b19f-c4e41c2d2471 req-87ae9d97-a424-450b-b239-0dc5556418ab service nova] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Received unexpected event network-vif-plugged-72193ca5-011d-4cf8-b016-194d83952281 for instance with vm_state deleted and task_state None.
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 474af9f8-6700-4288-8133-a8dad4cf8a88 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408610.0931203, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:50 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Resumed (Lifecycle Event)
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5eabddb0-59cd-4f99-88e4-01aafb8447b3 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:50 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408610.0932848, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:50 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Started (Lifecycle Event)
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Starting finish_revert_migration {{(pid=71354) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start _get_guest_xml network_info=[{"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'addabf69-0d6f-40f7-b65f-039a6b38a54b', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08984ef0-6db9-4a60-b5b9-a6325ec531b1', 'attached_at': '2023-04-13T17:56:51.000000', 'detached_at': '', 'volume_id': 'dc848d65-78d3-466f-9c07-311725e1d7ba', 'serial': 'dc848d65-78d3-466f-9c07-311725e1d7ba'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:56:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:50 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:56:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:56:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:56:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:56:51 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afbb7f-586e-4f1c-9d15-9205e01443cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:56:51 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9635c45a-9bfd-42e3-ae9b-9f06ef469c78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba] added
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfdc88d-ca15-414f-8b4f-921a4d02799b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad4f02-4ea3-44f8-99b9-e09adad541ae]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVlrLEtO" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c322a-2b4f-470f-ba86-1fd05b7f46c3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVlrLEtO'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7dc9f2-6024-4676-b939-5fe9c902385c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3706e71-bf83-40e2-b73e-b7cfb1cd3f64]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081a7c0-423d-484a-a2d9-5fb7b8b78ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:56:51 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f4387c-f083-441a-8425-b5dae6a59af4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ccd768-6996-493c-bfe7-8db9d03b95f7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:56:51 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:56:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[581878ef-f7ae-4ed2-8400-46e5806dbd5e]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161613764396464', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:55:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:56:52 user nova-compute[71354]:   <uuid>08984ef0-6db9-4a60-b5b9-a6325ec531b1</uuid>
Apr 13 17:56:52 user nova-compute[71354]:   <name>instance-00000003</name>
Apr 13 17:56:52 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:56:52 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:56:52 user nova-compute[71354]:   <metadata>
Apr 13 17:56:52 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:56:52 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-127366011</nova:name>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:56:50</nova:creationTime>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:56:52 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:56:52 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:owner>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 17:56:52 user nova-compute[71354]:       </nova:owner>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:56:52 user nova-compute[71354]:       <nova:ports>
Apr 13 17:56:52 user nova-compute[71354]:         <nova:port uuid="067fbe09-ace1-4188-a99f-ee4847a1a311">
Apr 13 17:56:52 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 17:56:52 user nova-compute[71354]:         </nova:port>
Apr 13 17:56:52 user nova-compute[71354]:       </nova:ports>
Apr 13 17:56:52 user nova-compute[71354]:     </nova:instance>
Apr 13 17:56:52 user nova-compute[71354]:   </metadata>
Apr 13 17:56:52 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:56:52 user nova-compute[71354]:     <system>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="serial">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="uuid">08984ef0-6db9-4a60-b5b9-a6325ec531b1</entry>
Apr 13 17:56:52 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:56:52 user nova-compute[71354]:     </system>
Apr 13 17:56:52 user nova-compute[71354]:   </sysinfo>
Apr 13 17:56:52 user nova-compute[71354]:   <os>
Apr 13 17:56:52 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:56:52 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:56:52 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:56:52 user nova-compute[71354]:   </os>
Apr 13 17:56:52 user nova-compute[71354]:   <features>
Apr 13 17:56:52 user nova-compute[71354]:     <acpi/>
Apr 13 17:56:52 user nova-compute[71354]:     <apic/>
Apr 13 17:56:52 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:56:52 user nova-compute[71354]:   </features>
Apr 13 17:56:52 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:56:52 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:56:52 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:56:52 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:56:52 user nova-compute[71354]:   </clock>
Apr 13 17:56:52 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:56:52 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:56:52 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:56:52 user nova-compute[71354]:   </cpu>
Apr 13 17:56:52 user nova-compute[71354]:   <devices>
Apr 13 17:56:52 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:56:52 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:56:52 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk"/>
Apr 13 17:56:52 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:56:52 user nova-compute[71354]:     </disk>
Apr 13 17:56:52 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:56:52 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:56:52 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 17:56:52 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 17:56:52 user nova-compute[71354]:       <serial>dc848d65-78d3-466f-9c07-311725e1d7ba</serial>
Apr 13 17:56:52 user nova-compute[71354]:     </disk>
Apr 13 17:56:52 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:56:52 user nova-compute[71354]:       <mac address="fa:16:3e:78:5c:7c"/>
Apr 13 17:56:52 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:56:52 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:56:52 user nova-compute[71354]:       <target dev="tap067fbe09-ac"/>
Apr 13 17:56:52 user nova-compute[71354]:     </interface>
Apr 13 17:56:52 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:56:52 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/console.log" append="off"/>
Apr 13 17:56:52 user nova-compute[71354]:     </serial>
Apr 13 17:56:52 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:56:52 user nova-compute[71354]:     <video>
Apr 13 17:56:52 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:56:52 user nova-compute[71354]:     </video>
Apr 13 17:56:52 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:56:52 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:56:52 user nova-compute[71354]:     </rng>
Apr 13 17:56:52 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:56:52 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:56:52 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:56:52 user nova-compute[71354]:     </memballoon>
Apr 13 17:56:52 user nova-compute[71354]:   </devices>
Apr 13 17:56:52 user nova-compute[71354]: </domain>
Apr 13 17:56:52 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:55:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG os_vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067fbe09-ac, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067fbe09-ac, col_values=(('external_ids', {'iface-id': '067fbe09-ace1-4188-a99f-ee4847a1a311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5c:7c', 'vm-uuid': '08984ef0-6db9-4a60-b5b9-a6325ec531b1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:52 user nova-compute[71354]: INFO os_vif [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for 08984ef0-6db9-4a60-b5b9-a6325ec531b1 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408616.3366535, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Resumed (Lifecycle Event)
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:56 user nova-compute[71354]: WARNING nova.compute.manager [req-56e674a6-fce7-4c89-b513-96914dff343a req-fa3a9be4-f9b6-4caf-817f-72bfc286498f service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state resized and task_state resize_reverting.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:56:56 user nova-compute[71354]: WARNING nova.compute.manager [req-0037fbb5-266a-4a76-ad3d-7806d1ee7407 req-68de10d3-3cf6-4196-a1a5-a2cf5e622e65 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state resized and task_state resize_reverting.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:56 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:56 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7818MB free_disk=26.22241973876953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance running successfully.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] finish_revert_migration finished successfully. {{(pid=71354) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408616.3385067, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Started (Lifecycle Event)
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dc1716d8-163a-4a50-8b3a-dbde50340fb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:56:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:56:56 user nova-compute[71354]: INFO nova.compute.manager [None req-b9bdaed0-3bb9-4845-9fe1-57ef7dcc2d2b tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance to original state: 'active'
Apr 13 17:56:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:56:57 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:56:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:56:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:56:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:57:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing instance network info cache due to event network-changed-8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Acquiring lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Acquired lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Refreshing network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:03 user nova-compute[71354]: INFO nova.compute.manager [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Terminating instance
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408608.168743, 1753314b-bfd7-4e8b-986b-0253666ab8aa => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:57:03 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] VM Stopped (Lifecycle Event)
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-13e0642a-60a1-4fab-9a00-0f8646ac310c None None] [instance: 1753314b-bfd7-4e8b-986b-0253666ab8aa] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.compute.manager [req-890a1b03-7cf2-41bf-a02e-9aac2b71149e req-dbb01024-fa1c-4a21-982c-a2dd99ed0b67 service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-unplugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updated VIF entry in instance network info cache for port 8064fded-37fe-474e-bf38-2f6c094dd0d0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [{"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a29e4678-fad0-4a86-924b-aceb15531298 req-4da3b3c6-c84c-420b-b0c3-5dab071c3deb service nova] Releasing lock "refresh_cache-dc1716d8-163a-4a50-8b3a-dbde50340fb8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Instance destroyed successfully.
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lazy-loading 'resources' on Instance uuid dc1716d8-163a-4a50-8b3a-dbde50340fb8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1107166628',display_name='tempest-TestShelveInstance-server-1107166628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1107166628',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+7fvwpKiIT941SPCbdY9x4Jev0kmNw794zuyTRCpHksjAYtGwMPWm/1jEY16x/UTkRyA96KR24i+FrqltRAjlx3KlYCS1QyCMn13CUYjLuHW0Kxt41qWBnmQAfLfVj5A==',key_name='tempest-TestShelveInstance-822246976',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:55:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1775be5ea4c540b0a67bfe3468fd5901',ramdisk_id='',reservation_id='r-xym4c2m4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2002875852',owner_user_name='tempest-TestShelveInstance-2002875852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:55:27Z,user_data=None,user_id='8b8e4096bfa5458b81aa51dc55394cb9',uuid=dc1716d8-163a-4a50-8b3a-dbde50340fb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converting VIF {"id": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "address": "fa:16:3e:cc:87:cd", "network": {"id": "ada8cd69-34be-4d1d-acc5-79e9d24f1c14", "bridge": "br-int", "label": "tempest-TestShelveInstance-887415403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1775be5ea4c540b0a67bfe3468fd5901", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8064fded-37", "ovs_interfaceid": "8064fded-37fe-474e-bf38-2f6c094dd0d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_vif [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8064fded-37, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:57:04 user nova-compute[71354]: INFO os_vif [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:87:cd,bridge_name='br-int',has_traffic_filtering=True,id=8064fded-37fe-474e-bf38-2f6c094dd0d0,network=Network(ada8cd69-34be-4d1d-acc5-79e9d24f1c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8064fded-37')
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnhzMFwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:57:04 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01953ae4-6c1b-4353-9b63-43e601d205a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:57:04 user nova-compute[71354]: No targets found.
Apr 13 17:57:04 user nova-compute[71354]: iSNS:
Apr 13 17:57:04 user nova-compute[71354]: No targets found.
Apr 13 17:57:04 user nova-compute[71354]: STATIC:
Apr 13 17:57:04 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:57:04 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:04 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:04 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87
Apr 13 17:57:04 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:04 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:04 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:57:04 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:04 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:04 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:57:04 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:04 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:04 user nova-compute[71354]: FIRMWARE:
Apr 13 17:57:04 user nova-compute[71354]: No targets found.
Apr 13 17:57:04 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:57:04 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:57:04 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7678c43-7ea7-4db4-bd92-b8f4abba9e63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb223a3-d4c0-4d8c-a4bb-9e71f7bf63b0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:04 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:04 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:04 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d41e81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c660e-fb57-4905-b905-854e0e8ff6db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef9f362-182e-4ea0-88cf-879e5f738321]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7927b6-bc21-48ce-b623-a3731642c9a4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0195ba0-7a01-4908-a252-871ab2688e19]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_147cb277',) {{(pid=81468) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[04220176-98ed-4b94-9834-d22296e14402]: (4, None) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251e712-bf84-42c5-86b9-bd00f3f0c398]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b46d6b-1021-4aea-a6f1-dbd54247a9bd]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260]
Apr 13 17:57:04 user nova-compute[71354]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87, portal: 172.16.0.220,3260] successful.
Apr 13 17:57:04 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520be0ee-ea06-4b16-8773-a8d5b9e40c87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad04fb-b169-4e2d-ab4e-a6e36ba7e401]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] <== disconnect_volume: return (310ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:57:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deleting instance files /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8_del
Apr 13 17:57:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deletion of /opt/stack/data/nova/instances/dc1716d8-163a-4a50-8b3a-dbde50340fb8_del complete
Apr 13 17:57:04 user nova-compute[71354]: INFO nova.compute.manager [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 13 17:57:04 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:57:04 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:04 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Took 0.46 seconds to deallocate network for instance.
Apr 13 17:57:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Acquiring lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] No waiting events found dispatching network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:57:05 user nova-compute[71354]: WARNING nova.compute.manager [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received unexpected event network-vif-plugged-8064fded-37fe-474e-bf38-2f6c094dd0d0 for instance with vm_state active and task_state deleting.
Apr 13 17:57:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-ff8992f8-6665-46d6-88b8-0db2f8fa701f req-a0aef8cb-8bce-42b5-8378-70bfc15d54df service nova] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Received event network-vif-deleted-8064fded-37fe-474e-bf38-2f6c094dd0d0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:05 user nova-compute[71354]: INFO nova.compute.manager [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Took 0.85 seconds to detach 1 volumes for instance.
Apr 13 17:57:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Deleting volume: 520be0ee-ea06-4b16-8773-a8d5b9e40c87 {{(pid=71354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:06 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:57:06 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:57:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:06 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Deleted allocations for instance dc1716d8-163a-4a50-8b3a-dbde50340fb8
Apr 13 17:57:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3bc145d7-4b93-4226-92b2-62911ae86468 tempest-TestShelveInstance-2002875852 tempest-TestShelveInstance-2002875852-project-member] Lock "dc1716d8-163a-4a50-8b3a-dbde50340fb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:19 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408624.031754, dc1716d8-163a-4a50-8b3a-dbde50340fb8 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:57:19 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] VM Stopped (Lifecycle Event)
Apr 13 17:57:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-82ba45cf-9f8f-4346-b88b-43fe6b46fd96 None None] [instance: dc1716d8-163a-4a50-8b3a-dbde50340fb8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:57:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing instance network info cache due to event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Acquiring lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Acquired lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.network.neutron [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:20 user nova-compute[71354]: INFO nova.compute.manager [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Attaching volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 to /dev/vdb
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.network.neutron [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updated VIF entry in instance network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.network.neutron [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.utils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-834c3261-4477-49ae-8a27-806bdd6f431f req-c163a1d4-e1de-4216-b5ee-5a928594d22c service nova] Releasing lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa717e4-a833-4025-959c-6b8333b2e46f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c209e05-d220-4583-8150-7020e4022984]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed64129-5c8b-4235-81bb-f4bd92c6e97b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9591b8-7427-4d0e-8dd8-4abf8f40e780]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:57:20 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:57:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd64629-bf9d-4765-bb45-2557910ed471]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG os_brick.utils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:57:20 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating existing volume attachment record: ffa07eee-46bd-443e-844f-f4d3f407f29e {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:57:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGxaXFwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:57:25 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:57:25 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:57:25 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad3f0e0-86d7-4950-9acc-8d68715e3cd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:57:25 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f33e7-7b43-414e-93f5-52dd8681fbb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3] added
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c2a1a0-71b1-43d3-95ad-dff1f8569c59]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15100fb-8a22-49d7-9e5d-0559daedea52]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGxaXFwf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGxaXFwf" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce61579-eca5-4d53-8019-7fabe4047b66]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hGxaXFwf'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496696f-ad77-45ae-8a14-5e38a6665352]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3708648e-5111-4c87-a370-76a3e9e87074]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3490d-abcc-4973-871a-620432f13f6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260]
Apr 13 17:57:25 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260] successful.
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[700be9a5-0a6b-4de7-8794-436b4d1013a8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b547a5-f31c-4ce0-98f5-6d9f78d05303]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:25 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd7b94-8398-4608-b8ae-9d8109733b7d]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:57:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGxaXFwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:57:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:57:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23339346239343535', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:57:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339346239343535', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:57:26 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:57:26 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:57:26 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:57:26 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:57:26 user nova-compute[71354]:   <serial>2e5aab40-4eb4-44b3-a738-4f230bae10b3</serial>
Apr 13 17:57:26 user nova-compute[71354]: </disk>
Apr 13 17:57:26 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No VIF found with MAC fa:16:3e:30:29:50, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing instance network info cache due to event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0d93ae40-d2e8-4879-9d1f-5b6a86e85022 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.521s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updated VIF entry in instance network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dd36cfc0-cabe-4228-8b2a-8bbfd06c99b6 req-2bb51a96-0596-4ae4-b608-050850260a9d service nova] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:28 user nova-compute[71354]: INFO nova.compute.manager [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Detaching volume c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:57:28 user nova-compute[71354]: INFO nova.virt.block_device [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Attempting to driver detach volume c60a8519-20b4-4b4e-8b21-368ebb46656e from mountpoint /dev/vdb
Apr 13 17:57:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Attempting to detach device vdb from instance 37a22063-cedb-45b0-8554-b1e60a7d4324 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:57:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:57:28 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:57:28 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 17:57:28 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:57:28 user nova-compute[71354]:   <serial>c60a8519-20b4-4b4e-8b21-368ebb46656e</serial>
Apr 13 17:57:28 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:57:28 user nova-compute[71354]: </disk>
Apr 13 17:57:28 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:57:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully detached device vdb from instance 37a22063-cedb-45b0-8554-b1e60a7d4324 from the persistent domain config.
Apr 13 17:57:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37a22063-cedb-45b0-8554-b1e60a7d4324 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:57:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:57:28 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:57:28 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 17:57:28 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:57:28 user nova-compute[71354]:   <serial>c60a8519-20b4-4b4e-8b21-368ebb46656e</serial>
Apr 13 17:57:28 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:57:28 user nova-compute[71354]: </disk>
Apr 13 17:57:28 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408649.044447, 37a22063-cedb-45b0-8554-b1e60a7d4324 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:57:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully detached device vdb from instance 37a22063-cedb-45b0-8554-b1e60a7d4324 from the live domain config.
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dfBKmNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:57:29 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8244c-170c-4ea0-b1cc-07e6e628f20c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:57:29 user nova-compute[71354]: No targets found.
Apr 13 17:57:29 user nova-compute[71354]: iSNS:
Apr 13 17:57:29 user nova-compute[71354]: No targets found.
Apr 13 17:57:29 user nova-compute[71354]: STATIC:
Apr 13 17:57:29 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3
Apr 13 17:57:29 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:29 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:29 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:57:29 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:29 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:29 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:57:29 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:29 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:29 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e
Apr 13 17:57:29 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:29 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:29 user nova-compute[71354]: FIRMWARE:
Apr 13 17:57:29 user nova-compute[71354]: No targets found.
Apr 13 17:57:29 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:57:29 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:57:29 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679e729-d187-4bc5-a6b7-b9e07891f05e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290d5f3-a602-4fdf-a73e-3bbf90eadff0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:29 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:29 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:29 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc3d0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing instance network info cache due to event network-changed-c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Acquiring lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Acquired lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Refreshing network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ee25e2-7ce8-40df-8c19-09ea1a73a8d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f543ce55-10b2-46f4-9220-e6eb34798dac]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e30aaa3-3e0d-415a-9d74-4903356aa54f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2042ffb7-b985-4606-9b72-2ade354a3f5d]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321b478-5594-41d5-a1a0-f168f33da52d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ee82d-1fe2-457d-9740-34742adddda2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260]
Apr 13 17:57:29 user nova-compute[71354]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e, portal: 172.16.0.220,3260] successful.
Apr 13 17:57:29 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60a8519-20b4-4b4e-8b21-368ebb46656e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0afe4a3-8e4f-4287-ac76-c3e18e66796c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] <== disconnect_volume: return (336ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:29 user nova-compute[71354]: INFO nova.compute.manager [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Detaching volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3
Apr 13 17:57:29 user nova-compute[71354]: INFO nova.virt.block_device [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Attempting to driver detach volume 2e5aab40-4eb4-44b3-a738-4f230bae10b3 from mountpoint /dev/vdb
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Attempting to detach device vdb from instance 9851b648-0b93-441b-9912-2216b528d030 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:57:29 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:57:29 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:57:29 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:57:29 user nova-compute[71354]:   <serial>2e5aab40-4eb4-44b3-a738-4f230bae10b3</serial>
Apr 13 17:57:29 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:57:29 user nova-compute[71354]: </disk>
Apr 13 17:57:29 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:57:29 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully detached device vdb from instance 9851b648-0b93-441b-9912-2216b528d030 from the persistent domain config.
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9851b648-0b93-441b-9912-2216b528d030 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:57:29 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:57:29 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 17:57:29 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:57:29 user nova-compute[71354]:   <serial>2e5aab40-4eb4-44b3-a738-4f230bae10b3</serial>
Apr 13 17:57:29 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:57:29 user nova-compute[71354]: </disk>
Apr 13 17:57:29 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updated VIF entry in instance network info cache for port c42e9982-60be-4b92-8ea1-460ff84f6a26. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG nova.network.neutron [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [{"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a2997d5e-977d-47cc-b77d-ffa31efdfba4 req-fc80fb9d-31a2-4a8f-9f21-e65e6be4d5e0 service nova] Releasing lock "refresh_cache-37a22063-cedb-45b0-8554-b1e60a7d4324" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408650.0571377, 9851b648-0b93-441b-9912-2216b528d030 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:57:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully detached device vdb from instance 9851b648-0b93-441b-9912-2216b528d030 from the live domain config.
Apr 13 17:57:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGxaXFwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:57:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6eaae-3ba8-48f3-b731-661f2724e1b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:57:30 user nova-compute[71354]: No targets found.
Apr 13 17:57:30 user nova-compute[71354]: iSNS:
Apr 13 17:57:30 user nova-compute[71354]: No targets found.
Apr 13 17:57:30 user nova-compute[71354]: STATIC:
Apr 13 17:57:30 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3
Apr 13 17:57:30 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:30 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:30 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:57:30 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:30 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:30 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:57:30 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:57:30 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:57:30 user nova-compute[71354]: FIRMWARE:
Apr 13 17:57:30 user nova-compute[71354]: No targets found.
Apr 13 17:57:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:57:30 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:57:30 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211835e-a4e0-494b-9ed5-b5eee5d46240]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabbe51-604d-403d-bb7a-c663257fa0d4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:30 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:30 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:57:30 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:57:30 user nova-compute[71354]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 (non-flash)
Apr 13 17:57:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc3c92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbfa06a-3309-425e-80af-2d61531ecbff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[663affd9-865e-4de2-97a7-d67f5e09f63f]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd2a473-3561-4535-89c3-87560f619310]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c4a26-b09e-45c3-ab16-50bd39c82cb6]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf246c-3c9c-4704-967d-384131298d63]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'flavor' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-424f6308-243d-4f20-86be-a89a8f1f8f1c tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.903s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0191cc-7447-48fe-9157-43a04890ea37]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260]
Apr 13 17:57:30 user nova-compute[71354]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3, portal: 172.16.0.220,3260] successful.
Apr 13 17:57:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5aab40-4eb4-44b3-a738-4f230bae10b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f57512e-95f9-42dc-86bb-a0131889f802]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== disconnect_volume: return (321ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:57:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:57:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4cdffafc-4b8f-41fa-ae32-b9cce5e642aa tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.904s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:57:41 user nova-compute[71354]: INFO nova.compute.claims [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Claim successful on node user
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:57:41 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:57:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.policy [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be9926ecd1d45d89aba2e65ac3e0bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3589c01630f4f83a6925d97943c574b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:57:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Creating image(s)
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk 1073741824" returned: 0 in 0.063s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Cannot resize image /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'migration_context' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Ensure instance console log exists: /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Successfully created port: af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Successfully updated port: af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-changed-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing instance network info cache due to event network-changed-af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.neutron [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance network_info: |[{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.neutron [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing network info cache for port af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start _get_guest_xml network_info=[{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:57:44 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:57:44 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZyKsU5d3bmL/UYx8WaLL5HbYx/LyhlGbrsQ08rU0/9ERgJOpMA/oSP5ygT2oWoSAVJJWq6FEawBSbz8eCp+eykT1Y1DqGMQv/islvnWWLiXrHaPJ09U0W9Wfw/KjAghA==',key_name='tempest-keypair-91694189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.objects.instance [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_devices' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:57:44 user nova-compute[71354]:   <uuid>ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</uuid>
Apr 13 17:57:44 user nova-compute[71354]:   <name>instance-00000018</name>
Apr 13 17:57:44 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:57:44 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:57:44 user nova-compute[71354]:   <metadata>
Apr 13 17:57:44 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:57:44 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-634185266</nova:name>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:57:44</nova:creationTime>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:57:44 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:57:44 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:owner>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:user uuid="6be9926ecd1d45d89aba2e65ac3e0bfc">tempest-AttachVolumeShelveTestJSON-1896381340-project-member</nova:user>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:project uuid="c3589c01630f4f83a6925d97943c574b">tempest-AttachVolumeShelveTestJSON-1896381340</nova:project>
Apr 13 17:57:44 user nova-compute[71354]:       </nova:owner>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:57:44 user nova-compute[71354]:       <nova:ports>
Apr 13 17:57:44 user nova-compute[71354]:         <nova:port uuid="af96f300-946c-444d-9604-b33d7fba78f3">
Apr 13 17:57:44 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 17:57:44 user nova-compute[71354]:         </nova:port>
Apr 13 17:57:44 user nova-compute[71354]:       </nova:ports>
Apr 13 17:57:44 user nova-compute[71354]:     </nova:instance>
Apr 13 17:57:44 user nova-compute[71354]:   </metadata>
Apr 13 17:57:44 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:57:44 user nova-compute[71354]:     <system>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="serial">ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</entry>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="uuid">ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</entry>
Apr 13 17:57:44 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:57:44 user nova-compute[71354]:     </system>
Apr 13 17:57:44 user nova-compute[71354]:   </sysinfo>
Apr 13 17:57:44 user nova-compute[71354]:   <os>
Apr 13 17:57:44 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:57:44 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:57:44 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:57:44 user nova-compute[71354]:   </os>
Apr 13 17:57:44 user nova-compute[71354]:   <features>
Apr 13 17:57:44 user nova-compute[71354]:     <acpi/>
Apr 13 17:57:44 user nova-compute[71354]:     <apic/>
Apr 13 17:57:44 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:57:44 user nova-compute[71354]:   </features>
Apr 13 17:57:44 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:57:44 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:57:44 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:57:44 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:57:44 user nova-compute[71354]:   </clock>
Apr 13 17:57:44 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:57:44 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:57:44 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:57:44 user nova-compute[71354]:   </cpu>
Apr 13 17:57:44 user nova-compute[71354]:   <devices>
Apr 13 17:57:44 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:57:44 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:57:44 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk"/>
Apr 13 17:57:44 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:57:44 user nova-compute[71354]:     </disk>
Apr 13 17:57:44 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:57:44 user nova-compute[71354]:       <mac address="fa:16:3e:fa:87:98"/>
Apr 13 17:57:44 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:57:44 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:57:44 user nova-compute[71354]:       <target dev="tapaf96f300-94"/>
Apr 13 17:57:44 user nova-compute[71354]:     </interface>
Apr 13 17:57:44 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:57:44 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/console.log" append="off"/>
Apr 13 17:57:44 user nova-compute[71354]:     </serial>
Apr 13 17:57:44 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:57:44 user nova-compute[71354]:     <video>
Apr 13 17:57:44 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:57:44 user nova-compute[71354]:     </video>
Apr 13 17:57:44 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:57:44 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:57:44 user nova-compute[71354]:     </rng>
Apr 13 17:57:44 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:57:44 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:57:44 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:57:44 user nova-compute[71354]:     </memballoon>
Apr 13 17:57:44 user nova-compute[71354]:   </devices>
Apr 13 17:57:44 user nova-compute[71354]: </domain>
Apr 13 17:57:44 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZyKsU5d3bmL/UYx8WaLL5HbYx/LyhlGbrsQ08rU0/9ERgJOpMA/oSP5ygT2oWoSAVJJWq6FEawBSbz8eCp+eykT1Y1DqGMQv/islvnWWLiXrHaPJ09U0W9Wfw/KjAghA==',key_name='tempest-keypair-91694189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG os_vif [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf96f300-94, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf96f300-94, col_values=(('external_ids', {'iface-id': 'af96f300-946c-444d-9604-b33d7fba78f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:87:98', 'vm-uuid': 'ea4760b7-c4a4-4d3f-a5db-680db0f4a32a'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:44 user nova-compute[71354]: INFO os_vif [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94')
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:57:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No VIF found with MAC fa:16:3e:fa:87:98, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:57:45 user nova-compute[71354]: DEBUG nova.network.neutron [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updated VIF entry in instance network info cache for port af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:57:45 user nova-compute[71354]: DEBUG nova.network.neutron [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-97e630e4-80e6-4197-8f9d-e64d8ac7f663 req-84240232-5c14-4941-8794-dab6df6e1feb service nova] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:57:46 user nova-compute[71354]: WARNING nova.compute.manager [req-7aa353c3-bd26-4bdd-9693-fbdb41e897b0 req-21e65235-f820-4e63-a569-e9022f777768 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state building and task_state spawning.
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408668.4354172, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Resumed (Lifecycle Event)
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance spawned successfully.
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408668.4410396, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Started (Lifecycle Event)
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:57:48 user nova-compute[71354]: WARNING nova.compute.manager [req-736da76e-1aec-428e-b210-1c51987d6caa req-8fd5480d-ee68-4fda-adc9-f8fafe7308db service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state building and task_state spawning.
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 13 17:57:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:57:48 user nova-compute[71354]: INFO nova.compute.manager [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Took 6.87 seconds to build instance.
Apr 13 17:57:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-84f66fe4-f506-4568-b409-dc507d57803b tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.984s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:57:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:50 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:57:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:55 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:57:55 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=26.208648681640625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:57:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:57:58 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:57:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:57:59 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:57:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:57:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:57:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:58:00 user nova-compute[71354]: INFO nova.compute.claims [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Claim successful on node user
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:58:00 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:58:00 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Creating image(s)
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "/opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "/opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "/opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.policy [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7a49ea3332547cbb44e26d070ac91b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d3c28f5394d338751e9760b2bf797', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk 1073741824" returned: 0 in 0.056s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Cannot resize image /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.objects.instance [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lazy-loading 'migration_context' on Instance uuid 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Ensure instance console log exists: /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Successfully created port: 054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Successfully updated port: 054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquired lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-changed-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Refreshing instance network info cache due to event network-changed-054e541d-7046-460e-b183-8ea6906af1e0. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Acquiring lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Updating instance_info_cache with network_info: [{"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Releasing lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Instance network_info: |[{"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Acquired lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.network.neutron [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Refreshing network info cache for port 054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Start _get_guest_xml network_info=[{"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:58:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:58:02 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2112694815',display_name='tempest-VolumesNegativeTest-instance-2112694815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2112694815',id=25,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='896d3c28f5394d338751e9760b2bf797',ramdisk_id='',reservation_id='r-ppap0i0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1324976558',owner_user_name='tempest-VolumesNegativeTest-1324976558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:01Z,user_data=None,user_id='c7a49ea3332547cbb44e26d070ac91b6',uuid=75eb1a09-48f8-4689-bd5e-9234ec6ac2f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converting VIF {"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.objects.instance [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lazy-loading 'pci_devices' on Instance uuid 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:58:03 user nova-compute[71354]:   <uuid>75eb1a09-48f8-4689-bd5e-9234ec6ac2f8</uuid>
Apr 13 17:58:03 user nova-compute[71354]:   <name>instance-00000019</name>
Apr 13 17:58:03 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:58:03 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:58:03 user nova-compute[71354]:   <metadata>
Apr 13 17:58:03 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:58:03 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:name>tempest-VolumesNegativeTest-instance-2112694815</nova:name>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:58:02</nova:creationTime>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:58:03 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:58:03 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:owner>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:user uuid="c7a49ea3332547cbb44e26d070ac91b6">tempest-VolumesNegativeTest-1324976558-project-member</nova:user>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:project uuid="896d3c28f5394d338751e9760b2bf797">tempest-VolumesNegativeTest-1324976558</nova:project>
Apr 13 17:58:03 user nova-compute[71354]:       </nova:owner>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:58:03 user nova-compute[71354]:       <nova:ports>
Apr 13 17:58:03 user nova-compute[71354]:         <nova:port uuid="054e541d-7046-460e-b183-8ea6906af1e0">
Apr 13 17:58:03 user nova-compute[71354]:           <nova:ip type="fixed" address="192.168.233.227" ipVersion="4"/>
Apr 13 17:58:03 user nova-compute[71354]:         </nova:port>
Apr 13 17:58:03 user nova-compute[71354]:       </nova:ports>
Apr 13 17:58:03 user nova-compute[71354]:     </nova:instance>
Apr 13 17:58:03 user nova-compute[71354]:   </metadata>
Apr 13 17:58:03 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:58:03 user nova-compute[71354]:     <system>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="serial">75eb1a09-48f8-4689-bd5e-9234ec6ac2f8</entry>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="uuid">75eb1a09-48f8-4689-bd5e-9234ec6ac2f8</entry>
Apr 13 17:58:03 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:58:03 user nova-compute[71354]:     </system>
Apr 13 17:58:03 user nova-compute[71354]:   </sysinfo>
Apr 13 17:58:03 user nova-compute[71354]:   <os>
Apr 13 17:58:03 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:58:03 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:58:03 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:58:03 user nova-compute[71354]:   </os>
Apr 13 17:58:03 user nova-compute[71354]:   <features>
Apr 13 17:58:03 user nova-compute[71354]:     <acpi/>
Apr 13 17:58:03 user nova-compute[71354]:     <apic/>
Apr 13 17:58:03 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:58:03 user nova-compute[71354]:   </features>
Apr 13 17:58:03 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:58:03 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:58:03 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:58:03 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:58:03 user nova-compute[71354]:   </clock>
Apr 13 17:58:03 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:58:03 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:58:03 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:58:03 user nova-compute[71354]:   </cpu>
Apr 13 17:58:03 user nova-compute[71354]:   <devices>
Apr 13 17:58:03 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:58:03 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:58:03 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk"/>
Apr 13 17:58:03 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:58:03 user nova-compute[71354]:     </disk>
Apr 13 17:58:03 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:58:03 user nova-compute[71354]:       <mac address="fa:16:3e:ca:a6:96"/>
Apr 13 17:58:03 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:03 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:58:03 user nova-compute[71354]:       <target dev="tap054e541d-70"/>
Apr 13 17:58:03 user nova-compute[71354]:     </interface>
Apr 13 17:58:03 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:58:03 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/console.log" append="off"/>
Apr 13 17:58:03 user nova-compute[71354]:     </serial>
Apr 13 17:58:03 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:58:03 user nova-compute[71354]:     <video>
Apr 13 17:58:03 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:03 user nova-compute[71354]:     </video>
Apr 13 17:58:03 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:58:03 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:58:03 user nova-compute[71354]:     </rng>
Apr 13 17:58:03 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:58:03 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:58:03 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:58:03 user nova-compute[71354]:     </memballoon>
Apr 13 17:58:03 user nova-compute[71354]:   </devices>
Apr 13 17:58:03 user nova-compute[71354]: </domain>
Apr 13 17:58:03 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2112694815',display_name='tempest-VolumesNegativeTest-instance-2112694815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2112694815',id=25,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='896d3c28f5394d338751e9760b2bf797',ramdisk_id='',reservation_id='r-ppap0i0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1324976558',owner_user_name='tempest-VolumesNegativeTest-1324976558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:01Z,user_data=None,user_id='c7a49ea3332547cbb44e26d070ac91b6',uuid=75eb1a09-48f8-4689-bd5e-9234ec6ac2f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converting VIF {"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG os_vif [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap054e541d-70, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap054e541d-70, col_values=(('external_ids', {'iface-id': '054e541d-7046-460e-b183-8ea6906af1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:a6:96', 'vm-uuid': '75eb1a09-48f8-4689-bd5e-9234ec6ac2f8'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:03 user nova-compute[71354]: INFO os_vif [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70')
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] No VIF found with MAC fa:16:3e:ca:a6:96, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Updated VIF entry in instance network info cache for port 054e541d-7046-460e-b183-8ea6906af1e0. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG nova.network.neutron [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Updating instance_info_cache with network_info: [{"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-63e661e2-9e19-4ec2-9d46-8b3ca68e9cc8 req-db5956a1-46be-4f66-a422-68daea7ab116 service nova] Releasing lock "refresh_cache-75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] No waiting events found dispatching network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:05 user nova-compute[71354]: WARNING nova.compute.manager [req-165390b8-191e-476c-b598-8721f6eb470a req-780d4d64-db12-4f28-9bd9-dc929aa9ecfc service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received unexpected event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 for instance with vm_state building and task_state spawning.
Apr 13 17:58:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408686.7371569, 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] VM Resumed (Lifecycle Event)
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Instance spawned successfully.
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408686.7380958, 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] VM Started (Lifecycle Event)
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Took 6.02 seconds to spawn the instance on the hypervisor.
Apr 13 17:58:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:06 user nova-compute[71354]: INFO nova.compute.manager [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Took 6.81 seconds to build instance.
Apr 13 17:58:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-57a63b80-ebe8-4070-8ac6-c6fd3ac6aa54 tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.902s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] No waiting events found dispatching network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:07 user nova-compute[71354]: WARNING nova.compute.manager [req-53c55c18-97c1-43ce-9669-9b7a9ee8baf2 req-1368e33a-9ff0-4791-b081-52ace59a72ca service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received unexpected event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 for instance with vm_state active and task_state None.
Apr 13 17:58:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:58:13 user nova-compute[71354]: INFO nova.compute.claims [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Claim successful on node user
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:58:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.policy [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:58:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Creating image(s)
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "/opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk 1073741824" returned: 0 in 0.048s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Cannot resize image /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'migration_context' on Instance uuid 561b1fe2-f0d2-4966-b449-4a139e570f06 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Ensure instance console log exists: /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Successfully created port: c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:58:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Successfully updated port: c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-changed-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Refreshing instance network info cache due to event network-changed-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Acquiring lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updating instance_info_cache with network_info: [{"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Instance network_info: |[{"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Acquired lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Refreshing network info cache for port c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Start _get_guest_xml network_info=[{"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:58:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1427952535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1427952535',id=26,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-j1auaxua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:14Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=561b1fe2-f0d2-4966-b449-4a139e570f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid 561b1fe2-f0d2-4966-b449-4a139e570f06 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:58:17 user nova-compute[71354]:   <uuid>561b1fe2-f0d2-4966-b449-4a139e570f06</uuid>
Apr 13 17:58:17 user nova-compute[71354]:   <name>instance-0000001a</name>
Apr 13 17:58:17 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:58:17 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:58:17 user nova-compute[71354]:   <metadata>
Apr 13 17:58:17 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:58:17 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1427952535</nova:name>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:58:17</nova:creationTime>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:58:17 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:58:17 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:owner>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 17:58:17 user nova-compute[71354]:       </nova:owner>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:58:17 user nova-compute[71354]:       <nova:ports>
Apr 13 17:58:17 user nova-compute[71354]:         <nova:port uuid="c1a4a453-df23-4bd0-bbfe-ce9941d98bf5">
Apr 13 17:58:17 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 17:58:17 user nova-compute[71354]:         </nova:port>
Apr 13 17:58:17 user nova-compute[71354]:       </nova:ports>
Apr 13 17:58:17 user nova-compute[71354]:     </nova:instance>
Apr 13 17:58:17 user nova-compute[71354]:   </metadata>
Apr 13 17:58:17 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:58:17 user nova-compute[71354]:     <system>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="serial">561b1fe2-f0d2-4966-b449-4a139e570f06</entry>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="uuid">561b1fe2-f0d2-4966-b449-4a139e570f06</entry>
Apr 13 17:58:17 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:58:17 user nova-compute[71354]:     </system>
Apr 13 17:58:17 user nova-compute[71354]:   </sysinfo>
Apr 13 17:58:17 user nova-compute[71354]:   <os>
Apr 13 17:58:17 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:58:17 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:58:17 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:58:17 user nova-compute[71354]:   </os>
Apr 13 17:58:17 user nova-compute[71354]:   <features>
Apr 13 17:58:17 user nova-compute[71354]:     <acpi/>
Apr 13 17:58:17 user nova-compute[71354]:     <apic/>
Apr 13 17:58:17 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:58:17 user nova-compute[71354]:   </features>
Apr 13 17:58:17 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:58:17 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:58:17 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:58:17 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:58:17 user nova-compute[71354]:   </clock>
Apr 13 17:58:17 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:58:17 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:58:17 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:58:17 user nova-compute[71354]:   </cpu>
Apr 13 17:58:17 user nova-compute[71354]:   <devices>
Apr 13 17:58:17 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:58:17 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:58:17 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk"/>
Apr 13 17:58:17 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:58:17 user nova-compute[71354]:     </disk>
Apr 13 17:58:17 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:58:17 user nova-compute[71354]:       <mac address="fa:16:3e:10:f7:f4"/>
Apr 13 17:58:17 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:17 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:58:17 user nova-compute[71354]:       <target dev="tapc1a4a453-df"/>
Apr 13 17:58:17 user nova-compute[71354]:     </interface>
Apr 13 17:58:17 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:58:17 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/console.log" append="off"/>
Apr 13 17:58:17 user nova-compute[71354]:     </serial>
Apr 13 17:58:17 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:58:17 user nova-compute[71354]:     <video>
Apr 13 17:58:17 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:17 user nova-compute[71354]:     </video>
Apr 13 17:58:17 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:58:17 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:58:17 user nova-compute[71354]:     </rng>
Apr 13 17:58:17 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:58:17 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:58:17 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:58:17 user nova-compute[71354]:     </memballoon>
Apr 13 17:58:17 user nova-compute[71354]:   </devices>
Apr 13 17:58:17 user nova-compute[71354]: </domain>
Apr 13 17:58:17 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1427952535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1427952535',id=26,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-j1auaxua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:14Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=561b1fe2-f0d2-4966-b449-4a139e570f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG os_vif [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a4a453-df, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1a4a453-df, col_values=(('external_ids', {'iface-id': 'c1a4a453-df23-4bd0-bbfe-ce9941d98bf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f7:f4', 'vm-uuid': '561b1fe2-f0d2-4966-b449-4a139e570f06'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:17 user nova-compute[71354]: INFO os_vif [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df')
Apr 13 17:58:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:10:f7:f4, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updated VIF entry in instance network info cache for port c1a4a453-df23-4bd0-bbfe-ce9941d98bf5. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updating instance_info_cache with network_info: [{"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fed55cd0-d058-42c9-a6bf-18846db0541d req-eedca3c5-101e-4bf0-8bcd-d874777eb807 service nova] Releasing lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] No waiting events found dispatching network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:19 user nova-compute[71354]: WARNING nova.compute.manager [req-e2f50994-c428-4aed-a8b3-c9effe080167 req-00d5e18f-1403-4260-9245-2cecf1692f27 service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received unexpected event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance with vm_state building and task_state spawning.
Apr 13 17:58:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408701.020113, 561b1fe2-f0d2-4966-b449-4a139e570f06 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] VM Resumed (Lifecycle Event)
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Instance spawned successfully.
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] No waiting events found dispatching network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:21 user nova-compute[71354]: WARNING nova.compute.manager [req-913717e5-f154-4d27-9029-72344b731d70 req-494e9a9f-0434-4442-915a-f2221793843e service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received unexpected event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance with vm_state building and task_state spawning.
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408701.0218637, 561b1fe2-f0d2-4966-b449-4a139e570f06 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] VM Started (Lifecycle Event)
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Took 7.33 seconds to spawn the instance on the hypervisor.
Apr 13 17:58:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:21 user nova-compute[71354]: INFO nova.compute.manager [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Took 8.08 seconds to build instance.
Apr 13 17:58:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4b1717ba-49e5-41cc-87ce-e697366deb1c tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.192s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:22 user nova-compute[71354]: INFO nova.compute.manager [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Terminating instance
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-00d910e6-2d82-4e12-ae65-dcba2f40bd37 req-c726ee4e-1715-41d0-b6dd-607179d586f1 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:58:22 user nova-compute[71354]: INFO nova.compute.claims [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Claim successful on node user
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Instance destroyed successfully.
Apr 13 17:58:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lazy-loading 'resources' on Instance uuid 37a22063-cedb-45b0-8554-b1e60a7d4324 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1896778579',display_name='tempest-TestMinimumBasicScenario-server-1896778579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1896778579',id=21,image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLysvbE0Zrt+5zeKxWLtNIm39mAiKNd+gGRtek5jM3u3q5+HDdY7ZVNT4gqmc4z9u+Zv3inGiNzJbMJwWIVELJjhr617KXuuTECL0R2iXXA0bPv4LE/O7ioJZYA/bq18fA==',key_name='tempest-TestMinimumBasicScenario-969682718',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bc3754064947c89397db4a80161b3a',ramdisk_id='',reservation_id='r-7yi0b8ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='28d6a612-1fe1-4e25-bad1-473206295a5a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587858147',owner_user_name='tempest-TestMinimumBasicScenario-1587858147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:55:44Z,user_data=None,user_id='8bdac67b9cc149b4b802c96fc87fc801',uuid=37a22063-cedb-45b0-8554-b1e60a7d4324,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converting VIF {"id": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "address": "fa:16:3e:34:15:00", "network": {"id": "53908975-b8a1-42b2-a261-83a8ab29f858", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1369372917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bc3754064947c89397db4a80161b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42e9982-60", "ovs_interfaceid": "c42e9982-60be-4b92-8ea1-460ff84f6a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG os_vif [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc42e9982-60, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:23 user nova-compute[71354]: INFO os_vif [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:15:00,bridge_name='br-int',has_traffic_filtering=True,id=c42e9982-60be-4b92-8ea1-460ff84f6a26,network=Network(53908975-b8a1-42b2-a261-83a8ab29f858),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42e9982-60')
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Deleting instance files /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324_del
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Deletion of /opt/stack/data/nova/instances/37a22063-cedb-45b0-8554-b1e60a7d4324_del complete
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.compute.manager [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.compute.manager [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] instance snapshotting
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Beginning live snapshot process
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.virt.block_device [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Booting with volume snapshot 9a7b2554-be2d-4da7-88fc-813febb6cd38 at /dev/vda
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.policy [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json -f qcow2" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-deleted-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.compute.manager [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Neutron deleted interface c42e9982-60be-4b92-8ea1-460ff84f6a26; detaching it from the instance and deleting it from the info cache
Apr 13 17:58:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:23 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Took 0.85 seconds to deallocate network for instance.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-f79a6d15-801e-4eec-b65a-6b035f472766 req-954ad160-961f-4403-93f8-fa0e94ecea52 service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Detach interface failed, port_id=c42e9982-60be-4b92-8ea1-460ff84f6a26, reason: Instance 37a22063-cedb-45b0-8554-b1e60a7d4324 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.172s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd.delta 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd.delta 1073741824" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:24 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Successfully created port: d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:24 user nova-compute[71354]: WARNING nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state deleted and task_state None.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:24 user nova-compute[71354]: WARNING nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state deleted and task_state None.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:24 user nova-compute[71354]: WARNING nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state deleted and task_state None.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:24 user nova-compute[71354]: WARNING nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-unplugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state deleted and task_state None.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Acquiring lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] No waiting events found dispatching network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:24 user nova-compute[71354]: WARNING nova.compute.manager [req-96c4e38f-0855-4f2f-811d-2cd692f94f35 req-39aecc6b-5a28-4064-b38b-d67515acc15d service nova] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Received unexpected event network-vif-plugged-c42e9982-60be-4b92-8ea1-460ff84f6a26 for instance with vm_state deleted and task_state None.
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Deleted allocations for instance 37a22063-cedb-45b0-8554-b1e60a7d4324
Apr 13 17:58:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc7a0bee-3e47-4aac-b5db-b3599d134067 tempest-TestMinimumBasicScenario-1587858147 tempest-TestMinimumBasicScenario-1587858147-project-member] Lock "37a22063-cedb-45b0-8554-b1e60a7d4324" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.586s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 17:58:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 17:58:25 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd.delta /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Successfully updated port: d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:58:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd.delta /opt/stack/data/nova/instances/snapshots/tmpwy5c462f/86cfc3735b5b4e3182752d064d6a54dd" returned: 0 in 0.502s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Snapshot extracted, beginning image upload
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-changed-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Refreshing instance network info cache due to event network-changed-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Acquiring lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updating instance_info_cache with network_info: [{"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Instance network_info: |[{"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Acquired lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Refreshing network info cache for port d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updated VIF entry in instance network info cache for port d87dbfc1-17d9-42b9-8713-eb1a2ee329a3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updating instance_info_cache with network_info: [{"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-78860e94-4d37-4ec1-95f7-eeb322ce5d37 req-b20a79ba-1810-455f-afa6-9afc869612b8 service nova] Releasing lock "refresh_cache-a594110c-a772-408d-8650-b5f2ab1e5f56" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Snapshot image upload complete
Apr 13 17:58:28 user nova-compute[71354]: INFO nova.compute.manager [None req-b79cfe13-a9bf-4d09-b380-ca5ebc4e9f83 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Took 4.90 seconds to snapshot the instance on the hypervisor.
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[03329fe8-82c7-49fe-9e47-edd07d73f074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2a4bdb-f2f9-4a70-a857-b6f65b39b117]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c6cc24-1e7f-42c0-a026-7ca736ed9dbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18408010-c418-4408-9f46-9bda430bea83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:58:29 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:58:29 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[02041bb8-72dd-4165-9624-1729f8bc890e]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG os_brick.utils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:58:29 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updating existing volume attachment record: 529bb86d-d444-4383-8f65-ea9f059621f9 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:31 user nova-compute[71354]: INFO nova.compute.manager [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Terminating instance
Apr 13 17:58:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Instance destroyed successfully.
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'resources' on Instance uuid bcfd107b-fef8-4acf-9a2c-1861aabacfe9 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1433621576',display_name='tempest-AttachVolumeTestJSON-server-1433621576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1433621576',id=13,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC38ZnwMYTMzHXD2GceNGrr4Gumod/2LZzQDIJSqXucHcHWwCtSADrGAbssCH4MPOOpQnKAi2WR+6KrGfbfPLRUNv0nq8yo4nXYUFqM0vEXInxpIgrpCFs2DpWsNvnIyAw==',key_name='tempest-keypair-1430946118',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-znj79irf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=bcfd107b-fef8-4acf-9a2c-1861aabacfe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "address": "fa:16:3e:9b:e2:8a", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap723c0bf0-b7", "ovs_interfaceid": "723c0bf0-b727-4ff6-b9fe-2197b7609fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG os_vif [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap723c0bf0-b7, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:32 user nova-compute[71354]: INFO os_vif [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=723c0bf0-b727-4ff6-b9fe-2197b7609fa0,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap723c0bf0-b7')
Apr 13 17:58:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Deleting instance files /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9_del
Apr 13 17:58:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Deletion of /opt/stack/data/nova/instances/bcfd107b-fef8-4acf-9a2c-1861aabacfe9_del complete
Apr 13 17:58:32 user nova-compute[71354]: INFO nova.compute.manager [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 17:58:32 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-5e320a13-b64e-4194-a338-ba3de07d2485 req-e4621244-fe3d-4e0b-b2aa-e3e4c4f6f96e service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-unplugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:58:33 user nova-compute[71354]: INFO nova.compute.claims [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Claim successful on node user
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:33 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Took 0.93 seconds to deallocate network for instance.
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-a140b089-729e-40ce-95bd-f8c7eaabc7ce req-fc548a2f-a04f-4801-ad3f-3f3dbf4066ec service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-deleted-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.323s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:58:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.policy [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b565bc35a4742808d360a395858134b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433b58054cc942efad3646ebf4ff286e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:58:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Creating image(s)
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "/opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "/opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "/opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "2c0ed91817b85e3241810d9b810a765592622ef9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "2c0ed91817b85e3241810d9b810a765592622ef9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Acquiring lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] No waiting events found dispatching network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:34 user nova-compute[71354]: WARNING nova.compute.manager [req-91f5eb9e-73a7-4db9-8cd0-6d5b09d946e9 req-a09f359f-35f7-4a06-8fc8-26e2d9c33fef service nova] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Received unexpected event network-vif-plugged-723c0bf0-b727-4ff6-b9fe-2197b7609fa0 for instance with vm_state deleted and task_state None.
Apr 13 17:58:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Successfully created port: a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.images [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] a530c0a0-c370-4663-9391-d6744c4948f9 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.part /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.428s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:35 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Deleted allocations for instance bcfd107b-fef8-4acf-9a2c-1861aabacfe9
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:58:35 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Creating image(s)
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Ensure instance console log exists: /opt/stack/data/nova/instances/a594110c-a772-408d-8650-b5f2ab1e5f56/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Start _get_guest_xml network_info=[{"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '529bb86d-d444-4383-8f65-ea9f059621f9', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwGNMQYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a594110c-a772-408d-8650-b5f2ab1e5f56', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 'serial': 'd4de66cb-c6a3-4c38-9a6b-13e4f4d61555'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.part /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.converted" returned: 0 in 0.171s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:35 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwGNMQYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:58:35 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:58:35 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:58:35 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a9a9564f-b5e5-4f65-802d-cca08cafc5bc tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "bcfd107b-fef8-4acf-9a2c-1861aabacfe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.821s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a610f58-f09f-47cd-b60a-0fa144602887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:58:35 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "2c0ed91817b85e3241810d9b810a765592622ef9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.421s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd704ec-2550-468d-b794-769a86419b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555] added
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ea7f5-f206-49f5-829b-e8c46d2fbf68]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b20da2-cd63-40c5-8065-ac86fab6fa5a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwGNMQYh {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwGNMQYh" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b1460-a901-4dbe-ada3-08519165ad19]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwGNMQYh'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bd292-5939-4abe-9b74-fc256ae00ac0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "2c0ed91817b85e3241810d9b810a765592622ef9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "2c0ed91817b85e3241810d9b810a765592622ef9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f33bc0-336f-4fc1-89a8-37170dfb114e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de138164-1d41-4f3e-9d01-bf50b684746e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260]
Apr 13 17:58:35 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260] successful.
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ffbec-00c8-45bd-a522-16eb6b0b3779]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9,backing_fmt=raw /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dd2f9-7e59-49ee-a192-05e31f57a792]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:58:35 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 17:58:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Successfully updated port: a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9,backing_fmt=raw /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk 1073741824" returned: 0 in 0.064s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "2c0ed91817b85e3241810d9b810a765592622ef9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6110b4e-f663-4cee-853d-780361263e88]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwGNMQYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing instance network info cache due to event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Acquiring lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Acquired lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing network info cache for port a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 --force-share --output=json" returned: 0 in 0.171s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'migration_context' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Ensure instance console log exists: /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.neutron [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a98b46e8-321a-4172-abf2-1dd7f0be02bf req-e25bbb59-83f9-4f03-bee0-b9aaf7189d49 service nova] Releasing lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquired lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating instance_info_cache with network_info: [{"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Releasing lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance network_info: |[{"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Start _get_guest_xml network_info=[{"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3b6ad23e410799455a75b8efab9daa90',container_format='bare',created_at=2023-04-13T17:58:23Z,direct_url=<?>,disk_format='qcow2',id=a530c0a0-c370-4663-9391-d6744c4948f9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1206725464',owner='433b58054cc942efad3646ebf4ff286e',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T17:58:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a530c0a0-c370-4663-9391-d6744c4948f9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:58:36 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:36 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3b6ad23e410799455a75b8efab9daa90',container_format='bare',created_at=2023-04-13T17:58:23Z,direct_url=<?>,disk_format='qcow2',id=a530c0a0-c370-4663-9391-d6744c4948f9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1206725464',owner='433b58054cc942efad3646ebf4ff286e',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T17:58:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-359301831',display_name='tempest-TestStampPattern-server-359301831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-359301831',id=28,image_ref='a530c0a0-c370-4663-9391-d6744c4948f9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-12s5nilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9851b648-0b93-441b-9912-2216b528d030',image_min_disk='1',image_min_ram='0',image_owner_id='433b58054cc942efad3646ebf4ff286e',image_owner_project_name='tempest-TestStampPattern-1307048889',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1307048889-project-member',image_user_id='2b565bc35a4742808d360a395858134b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:34Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=34d7146a-14c1-4dc2-9e98-d1f05bbf3712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'pci_devices' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:58:36 user nova-compute[71354]:   <uuid>34d7146a-14c1-4dc2-9e98-d1f05bbf3712</uuid>
Apr 13 17:58:36 user nova-compute[71354]:   <name>instance-0000001c</name>
Apr 13 17:58:36 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:58:36 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:58:36 user nova-compute[71354]:   <metadata>
Apr 13 17:58:36 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:58:36 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:name>tempest-TestStampPattern-server-359301831</nova:name>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:58:36</nova:creationTime>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:58:36 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:owner>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:user uuid="2b565bc35a4742808d360a395858134b">tempest-TestStampPattern-1307048889-project-member</nova:user>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:project uuid="433b58054cc942efad3646ebf4ff286e">tempest-TestStampPattern-1307048889</nova:project>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:owner>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:root type="image" uuid="a530c0a0-c370-4663-9391-d6744c4948f9"/>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:ports>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:port uuid="a494221d-1460-48b2-9a60-b2329efbf6bc">
Apr 13 17:58:36 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 17:58:36 user nova-compute[71354]:         </nova:port>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:ports>
Apr 13 17:58:36 user nova-compute[71354]:     </nova:instance>
Apr 13 17:58:36 user nova-compute[71354]:   </metadata>
Apr 13 17:58:36 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:58:36 user nova-compute[71354]:     <system>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="serial">34d7146a-14c1-4dc2-9e98-d1f05bbf3712</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="uuid">34d7146a-14c1-4dc2-9e98-d1f05bbf3712</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:58:36 user nova-compute[71354]:     </system>
Apr 13 17:58:36 user nova-compute[71354]:   </sysinfo>
Apr 13 17:58:36 user nova-compute[71354]:   <os>
Apr 13 17:58:36 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:58:36 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:58:36 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:58:36 user nova-compute[71354]:   </os>
Apr 13 17:58:36 user nova-compute[71354]:   <features>
Apr 13 17:58:36 user nova-compute[71354]:     <acpi/>
Apr 13 17:58:36 user nova-compute[71354]:     <apic/>
Apr 13 17:58:36 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:58:36 user nova-compute[71354]:   </features>
Apr 13 17:58:36 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:58:36 user nova-compute[71354]:   </clock>
Apr 13 17:58:36 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:58:36 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:58:36 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:58:36 user nova-compute[71354]:   </cpu>
Apr 13 17:58:36 user nova-compute[71354]:   <devices>
Apr 13 17:58:36 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:58:36 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:58:36 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk"/>
Apr 13 17:58:36 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:     </disk>
Apr 13 17:58:36 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:58:36 user nova-compute[71354]:       <mac address="fa:16:3e:1d:f0:45"/>
Apr 13 17:58:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:58:36 user nova-compute[71354]:       <target dev="tapa494221d-14"/>
Apr 13 17:58:36 user nova-compute[71354]:     </interface>
Apr 13 17:58:36 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:58:36 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/console.log" append="off"/>
Apr 13 17:58:36 user nova-compute[71354]:     </serial>
Apr 13 17:58:36 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:58:36 user nova-compute[71354]:     <video>
Apr 13 17:58:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:     </video>
Apr 13 17:58:36 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:58:36 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:58:36 user nova-compute[71354]:     </rng>
Apr 13 17:58:36 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:58:36 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:58:36 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:58:36 user nova-compute[71354]:     </memballoon>
Apr 13 17:58:36 user nova-compute[71354]:   </devices>
Apr 13 17:58:36 user nova-compute[71354]: </domain>
Apr 13 17:58:36 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-359301831',display_name='tempest-TestStampPattern-server-359301831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-359301831',id=28,image_ref='a530c0a0-c370-4663-9391-d6744c4948f9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-12s5nilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9851b648-0b93-441b-9912-2216b528d030',image_min_disk='1',image_min_ram='0',image_owner_id='433b58054cc942efad3646ebf4ff286e',image_owner_project_name='tempest-TestStampPattern-1307048889',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1307048889-project-member',image_user_id='2b565bc35a4742808d360a395858134b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:34Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=34d7146a-14c1-4dc2-9e98-d1f05bbf3712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG os_vif [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa494221d-14, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa494221d-14, col_values=(('external_ids', {'iface-id': 'a494221d-1460-48b2-9a60-b2329efbf6bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f0:45', 'vm-uuid': '34d7146a-14c1-4dc2-9e98-d1f05bbf3712'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: INFO os_vif [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14')
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No VIF found with MAC fa:16:3e:1d:f0:45, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26432363233613165', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432363233613165', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778851942',display_name='tempest-TestVolumeBootPattern-server-1778851942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778851942',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-0kh9noz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:23Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=a594110c-a772-408d-8650-b5f2ab1e5f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.objects.instance [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid a594110c-a772-408d-8650-b5f2ab1e5f56 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:58:36 user nova-compute[71354]:   <uuid>a594110c-a772-408d-8650-b5f2ab1e5f56</uuid>
Apr 13 17:58:36 user nova-compute[71354]:   <name>instance-0000001b</name>
Apr 13 17:58:36 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:58:36 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:58:36 user nova-compute[71354]:   <metadata>
Apr 13 17:58:36 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:58:36 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-server-1778851942</nova:name>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:58:35</nova:creationTime>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:58:36 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:owner>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:owner>
Apr 13 17:58:36 user nova-compute[71354]:       <nova:ports>
Apr 13 17:58:36 user nova-compute[71354]:         <nova:port uuid="d87dbfc1-17d9-42b9-8713-eb1a2ee329a3">
Apr 13 17:58:36 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 17:58:36 user nova-compute[71354]:         </nova:port>
Apr 13 17:58:36 user nova-compute[71354]:       </nova:ports>
Apr 13 17:58:36 user nova-compute[71354]:     </nova:instance>
Apr 13 17:58:36 user nova-compute[71354]:   </metadata>
Apr 13 17:58:36 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:58:36 user nova-compute[71354]:     <system>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="serial">a594110c-a772-408d-8650-b5f2ab1e5f56</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="uuid">a594110c-a772-408d-8650-b5f2ab1e5f56</entry>
Apr 13 17:58:36 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:58:36 user nova-compute[71354]:     </system>
Apr 13 17:58:36 user nova-compute[71354]:   </sysinfo>
Apr 13 17:58:36 user nova-compute[71354]:   <os>
Apr 13 17:58:36 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:58:36 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:58:36 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:58:36 user nova-compute[71354]:   </os>
Apr 13 17:58:36 user nova-compute[71354]:   <features>
Apr 13 17:58:36 user nova-compute[71354]:     <acpi/>
Apr 13 17:58:36 user nova-compute[71354]:     <apic/>
Apr 13 17:58:36 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:58:36 user nova-compute[71354]:   </features>
Apr 13 17:58:36 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:58:36 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:58:36 user nova-compute[71354]:   </clock>
Apr 13 17:58:36 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:58:36 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:58:36 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:58:36 user nova-compute[71354]:   </cpu>
Apr 13 17:58:36 user nova-compute[71354]:   <devices>
Apr 13 17:58:36 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 17:58:36 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:58:36 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 17:58:36 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:       <serial>d4de66cb-c6a3-4c38-9a6b-13e4f4d61555</serial>
Apr 13 17:58:36 user nova-compute[71354]:     </disk>
Apr 13 17:58:36 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:58:36 user nova-compute[71354]:       <mac address="fa:16:3e:26:3a:fa"/>
Apr 13 17:58:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:58:36 user nova-compute[71354]:       <target dev="tapd87dbfc1-17"/>
Apr 13 17:58:36 user nova-compute[71354]:     </interface>
Apr 13 17:58:36 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:58:36 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/a594110c-a772-408d-8650-b5f2ab1e5f56/console.log" append="off"/>
Apr 13 17:58:36 user nova-compute[71354]:     </serial>
Apr 13 17:58:36 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:58:36 user nova-compute[71354]:     <video>
Apr 13 17:58:36 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:36 user nova-compute[71354]:     </video>
Apr 13 17:58:36 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:58:36 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:58:36 user nova-compute[71354]:     </rng>
Apr 13 17:58:36 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:58:36 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:58:36 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:58:36 user nova-compute[71354]:     </memballoon>
Apr 13 17:58:36 user nova-compute[71354]:   </devices>
Apr 13 17:58:36 user nova-compute[71354]: </domain>
Apr 13 17:58:36 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778851942',display_name='tempest-TestVolumeBootPattern-server-1778851942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778851942',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-0kh9noz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:23Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=a594110c-a772-408d-8650-b5f2ab1e5f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG os_vif [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd87dbfc1-17, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd87dbfc1-17, col_values=(('external_ids', {'iface-id': 'd87dbfc1-17d9-42b9-8713-eb1a2ee329a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3a:fa', 'vm-uuid': 'a594110c-a772-408d-8650-b5f2ab1e5f56'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:36 user nova-compute[71354]: INFO os_vif [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17')
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:58:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:26:3a:fa, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:58:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:37 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408702.9603403, 37a22063-cedb-45b0-8554-b1e60a7d4324 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:37 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] VM Stopped (Lifecycle Event)
Apr 13 17:58:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5e8ff627-1a0b-4f7e-a6ad-49200adf966c None None] [instance: 37a22063-cedb-45b0-8554-b1e60a7d4324] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] No waiting events found dispatching network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:39 user nova-compute[71354]: WARNING nova.compute.manager [req-f5f49b25-90eb-42b8-85dd-d4b36143fb43 req-569d16b5-2222-490e-8c89-c0b838d0cb3c service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received unexpected event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc for instance with vm_state building and task_state spawning.
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] No waiting events found dispatching network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:39 user nova-compute[71354]: WARNING nova.compute.manager [req-ed38810e-2a36-4dc0-82a3-20f1fd30d238 req-d9f5ea2c-3ee3-49fa-899c-a86fd127f93d service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received unexpected event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance with vm_state building and task_state spawning.
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] No waiting events found dispatching network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:41 user nova-compute[71354]: WARNING nova.compute.manager [req-d1c6c3d4-5871-4c3e-b3c2-c6f5f74441fe req-72d52d97-0ce3-41be-b0d2-d08d5dd41449 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received unexpected event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc for instance with vm_state building and task_state spawning.
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.claims [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Claim successful on node user
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] No waiting events found dispatching network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:41 user nova-compute[71354]: WARNING nova.compute.manager [req-48af0257-5039-47a0-8662-50d6299149bf req-99e711e1-40b4-42b1-b7e2-81884ee1a23f service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received unexpected event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance with vm_state building and task_state spawning.
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408721.7608733, a594110c-a772-408d-8650-b5f2ab1e5f56 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] VM Resumed (Lifecycle Event)
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Instance spawned successfully.
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408721.7610066, a594110c-a772-408d-8650-b5f2ab1e5f56 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] VM Started (Lifecycle Event)
Apr 13 17:58:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Took 6.77 seconds to spawn the instance on the hypervisor.
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.policy [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f1fe2e6fd894d5c87d7ccf5fae553ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ac3ae1ebe4107a05bd27710b9502b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:58:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Creating image(s)
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408722.0040958, 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] VM Resumed (Lifecycle Event)
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance spawned successfully.
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Took 19.48 seconds to build instance.
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408722.014907, 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] VM Started (Lifecycle Event)
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-53e27977-1202-4ba0-8439-f2ff5293893d tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.585s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.172s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Took 8.26 seconds to spawn the instance on the hypervisor.
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:42 user nova-compute[71354]: INFO nova.compute.manager [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Took 9.10 seconds to build instance.
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5ad2dff2-8273-4eef-b367-b1100e69d973 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.248s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk 1073741824" returned: 0 in 0.049s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Successfully created port: 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Cannot resize image /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.objects.instance [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Ensure instance console log exists: /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Successfully updated port: 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing instance network info cache due to event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance network_info: |[{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.neutron [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start _get_guest_xml network_info=[{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:58:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-320463142',display_name='tempest-ServerRescueNegativeTestJSON-server-320463142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-320463142',id=29,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBsAPFHL1kEqtOmPsrJKB5vYho0rsY7MM2yfOo6HwS5Wp/30YJfBntr9RLJhPsW7Wt1wJtGkjLqIJ5RG3sY6B0IKcGOd0soxtl42k1xZK+fo8pt+njadFWbmK0xi8LMQ==',key_name='tempest-keypair-1158147748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-g7yn0ebl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=dd2b2a73-ff8a-4357-bad3-6be8fd95b374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:58:44 user nova-compute[71354]:   <uuid>dd2b2a73-ff8a-4357-bad3-6be8fd95b374</uuid>
Apr 13 17:58:44 user nova-compute[71354]:   <name>instance-0000001d</name>
Apr 13 17:58:44 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:58:44 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:58:44 user nova-compute[71354]:   <metadata>
Apr 13 17:58:44 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:58:44 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-320463142</nova:name>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:58:43</nova:creationTime>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:58:44 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:58:44 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:owner>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 17:58:44 user nova-compute[71354]:       </nova:owner>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:58:44 user nova-compute[71354]:       <nova:ports>
Apr 13 17:58:44 user nova-compute[71354]:         <nova:port uuid="2eab9a6c-32a8-4811-8005-1b4f1a6642f1">
Apr 13 17:58:44 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 17:58:44 user nova-compute[71354]:         </nova:port>
Apr 13 17:58:44 user nova-compute[71354]:       </nova:ports>
Apr 13 17:58:44 user nova-compute[71354]:     </nova:instance>
Apr 13 17:58:44 user nova-compute[71354]:   </metadata>
Apr 13 17:58:44 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:58:44 user nova-compute[71354]:     <system>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="serial">dd2b2a73-ff8a-4357-bad3-6be8fd95b374</entry>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="uuid">dd2b2a73-ff8a-4357-bad3-6be8fd95b374</entry>
Apr 13 17:58:44 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:58:44 user nova-compute[71354]:     </system>
Apr 13 17:58:44 user nova-compute[71354]:   </sysinfo>
Apr 13 17:58:44 user nova-compute[71354]:   <os>
Apr 13 17:58:44 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:58:44 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:58:44 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:58:44 user nova-compute[71354]:   </os>
Apr 13 17:58:44 user nova-compute[71354]:   <features>
Apr 13 17:58:44 user nova-compute[71354]:     <acpi/>
Apr 13 17:58:44 user nova-compute[71354]:     <apic/>
Apr 13 17:58:44 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:58:44 user nova-compute[71354]:   </features>
Apr 13 17:58:44 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:58:44 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:58:44 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:58:44 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:58:44 user nova-compute[71354]:   </clock>
Apr 13 17:58:44 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:58:44 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:58:44 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:58:44 user nova-compute[71354]:   </cpu>
Apr 13 17:58:44 user nova-compute[71354]:   <devices>
Apr 13 17:58:44 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:58:44 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:58:44 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk"/>
Apr 13 17:58:44 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:58:44 user nova-compute[71354]:     </disk>
Apr 13 17:58:44 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:58:44 user nova-compute[71354]:       <mac address="fa:16:3e:34:d0:51"/>
Apr 13 17:58:44 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:44 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:58:44 user nova-compute[71354]:       <target dev="tap2eab9a6c-32"/>
Apr 13 17:58:44 user nova-compute[71354]:     </interface>
Apr 13 17:58:44 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:58:44 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/console.log" append="off"/>
Apr 13 17:58:44 user nova-compute[71354]:     </serial>
Apr 13 17:58:44 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:58:44 user nova-compute[71354]:     <video>
Apr 13 17:58:44 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:58:44 user nova-compute[71354]:     </video>
Apr 13 17:58:44 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:58:44 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:58:44 user nova-compute[71354]:     </rng>
Apr 13 17:58:44 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:58:44 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:58:44 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:58:44 user nova-compute[71354]:     </memballoon>
Apr 13 17:58:44 user nova-compute[71354]:   </devices>
Apr 13 17:58:44 user nova-compute[71354]: </domain>
Apr 13 17:58:44 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-320463142',display_name='tempest-ServerRescueNegativeTestJSON-server-320463142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-320463142',id=29,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBsAPFHL1kEqtOmPsrJKB5vYho0rsY7MM2yfOo6HwS5Wp/30YJfBntr9RLJhPsW7Wt1wJtGkjLqIJ5RG3sY6B0IKcGOd0soxtl42k1xZK+fo8pt+njadFWbmK0xi8LMQ==',key_name='tempest-keypair-1158147748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-g7yn0ebl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=dd2b2a73-ff8a-4357-bad3-6be8fd95b374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG os_vif [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eab9a6c-32, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eab9a6c-32, col_values=(('external_ids', {'iface-id': '2eab9a6c-32a8-4811-8005-1b4f1a6642f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:d0:51', 'vm-uuid': 'dd2b2a73-ff8a-4357-bad3-6be8fd95b374'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:44 user nova-compute[71354]: INFO os_vif [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32')
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:34:d0:51, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.network.neutron [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updated VIF entry in instance network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG nova.network.neutron [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:58:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-969b9995-6b4f-4072-86e6-a006b696b4ff req-7e9a647a-02ba-4f00-ab36-0d7250f40eba service nova] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:45 user nova-compute[71354]: WARNING nova.compute.manager [req-04beea34-b344-4058-b9fa-86dfa9898be3 req-e503c5e3-1418-4174-b1b4-24f6cf1df631 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state building and task_state spawning.
Apr 13 17:58:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408712.2172105, bcfd107b-fef8-4acf-9a2c-1861aabacfe9 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] VM Stopped (Lifecycle Event)
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-32aa4007-a050-466f-b9a0-47a334968f33 None None] [instance: bcfd107b-fef8-4acf-9a2c-1861aabacfe9] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:58:47 user nova-compute[71354]: WARNING nova.compute.manager [req-8f9b067c-dcf3-4bc9-9242-53f29ad69e8d req-7039b17e-4fd6-4b0f-802a-123b9e823cd7 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state building and task_state spawning.
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408727.8370278, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Resumed (Lifecycle Event)
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance spawned successfully.
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408727.837837, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Started (Lifecycle Event)
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:58:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:58:48 user nova-compute[71354]: INFO nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Took 6.06 seconds to spawn the instance on the hypervisor.
Apr 13 17:58:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:58:48 user nova-compute[71354]: INFO nova.compute.manager [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Took 6.94 seconds to build instance.
Apr 13 17:58:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69281e9e-9c71-45f9-b2f3-fc5c8dc68c75 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.044s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:49 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:58:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:52 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:52 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:58:57 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:57 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7365MB free_disk=26.067119598388672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance a594110c-a772-408d-8650-b5f2ab1e5f56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:58:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:58:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:58:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:59:00 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:59:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:59:25 user nova-compute[71354]: INFO nova.compute.claims [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Claim successful on node user
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:59:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.policy [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91769944ac8048dbb1f418d232e670d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8ad9e1bc74eb9b9997f7706d3f096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:59:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Creating image(s)
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "/opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "/opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "/opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.127s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk 1073741824" returned: 0 in 0.051s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Successfully created port: d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Cannot resize image /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:59:26 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'migration_context' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Ensure instance console log exists: /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Successfully updated port: d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquired lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-changed-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Refreshing instance network info cache due to event network-changed-d86c3ad7-5ef2-4356-9a80-5bcf35099658. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Acquiring lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:59:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating instance_info_cache with network_info: [{"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Releasing lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Instance network_info: |[{"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Acquired lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Refreshing network info cache for port d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Start _get_guest_xml network_info=[{"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:59:28 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:59:28 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1049189686',display_name='tempest-AttachVolumeTestJSON-server-1049189686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1049189686',id=30,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+YgyiVk19kdaRjmu/uchZVpegteCHORgIR7ZHx/HQsZEpme4M4xwCCZxpEapxFRZcdjPYDWFEZ6h5hweGRRJKYFR156zpNQbuH12loKVtDCwW2nHgO6zKHfJTAmpolhw==',key_name='tempest-keypair-1877620197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-2l0f1td6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=3137ec3f-cb47-4ec9-8321-c6a2486633e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'pci_devices' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:59:28 user nova-compute[71354]:   <uuid>3137ec3f-cb47-4ec9-8321-c6a2486633e1</uuid>
Apr 13 17:59:28 user nova-compute[71354]:   <name>instance-0000001e</name>
Apr 13 17:59:28 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 17:59:28 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 17:59:28 user nova-compute[71354]:   <metadata>
Apr 13 17:59:28 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:59:28 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeTestJSON-server-1049189686</nova:name>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:creationTime>2023-04-13 17:59:28</nova:creationTime>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 17:59:28 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:59:28 user nova-compute[71354]:       </nova:flavor>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:owner>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:user uuid="91769944ac8048dbb1f418d232e670d3">tempest-AttachVolumeTestJSON-2087525588-project-member</nova:user>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:project uuid="5ee8ad9e1bc74eb9b9997f7706d3f096">tempest-AttachVolumeTestJSON-2087525588</nova:project>
Apr 13 17:59:28 user nova-compute[71354]:       </nova:owner>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 17:59:28 user nova-compute[71354]:       <nova:ports>
Apr 13 17:59:28 user nova-compute[71354]:         <nova:port uuid="d86c3ad7-5ef2-4356-9a80-5bcf35099658">
Apr 13 17:59:28 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 17:59:28 user nova-compute[71354]:         </nova:port>
Apr 13 17:59:28 user nova-compute[71354]:       </nova:ports>
Apr 13 17:59:28 user nova-compute[71354]:     </nova:instance>
Apr 13 17:59:28 user nova-compute[71354]:   </metadata>
Apr 13 17:59:28 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 17:59:28 user nova-compute[71354]:     <system>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="serial">3137ec3f-cb47-4ec9-8321-c6a2486633e1</entry>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="uuid">3137ec3f-cb47-4ec9-8321-c6a2486633e1</entry>
Apr 13 17:59:28 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:59:28 user nova-compute[71354]:     </system>
Apr 13 17:59:28 user nova-compute[71354]:   </sysinfo>
Apr 13 17:59:28 user nova-compute[71354]:   <os>
Apr 13 17:59:28 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:59:28 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 17:59:28 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 17:59:28 user nova-compute[71354]:   </os>
Apr 13 17:59:28 user nova-compute[71354]:   <features>
Apr 13 17:59:28 user nova-compute[71354]:     <acpi/>
Apr 13 17:59:28 user nova-compute[71354]:     <apic/>
Apr 13 17:59:28 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 17:59:28 user nova-compute[71354]:   </features>
Apr 13 17:59:28 user nova-compute[71354]:   <clock offset="utc">
Apr 13 17:59:28 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:59:28 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:59:28 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 17:59:28 user nova-compute[71354]:   </clock>
Apr 13 17:59:28 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 17:59:28 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 17:59:28 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:59:28 user nova-compute[71354]:   </cpu>
Apr 13 17:59:28 user nova-compute[71354]:   <devices>
Apr 13 17:59:28 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 17:59:28 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:59:28 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk"/>
Apr 13 17:59:28 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 17:59:28 user nova-compute[71354]:     </disk>
Apr 13 17:59:28 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 17:59:28 user nova-compute[71354]:       <mac address="fa:16:3e:6c:2d:6f"/>
Apr 13 17:59:28 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:59:28 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 17:59:28 user nova-compute[71354]:       <target dev="tapd86c3ad7-5e"/>
Apr 13 17:59:28 user nova-compute[71354]:     </interface>
Apr 13 17:59:28 user nova-compute[71354]:     <serial type="pty">
Apr 13 17:59:28 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/console.log" append="off"/>
Apr 13 17:59:28 user nova-compute[71354]:     </serial>
Apr 13 17:59:28 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:59:28 user nova-compute[71354]:     <video>
Apr 13 17:59:28 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 17:59:28 user nova-compute[71354]:     </video>
Apr 13 17:59:28 user nova-compute[71354]:     <rng model="virtio">
Apr 13 17:59:28 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:59:28 user nova-compute[71354]:     </rng>
Apr 13 17:59:28 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:59:28 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 17:59:28 user nova-compute[71354]:       <stats period="10"/>
Apr 13 17:59:28 user nova-compute[71354]:     </memballoon>
Apr 13 17:59:28 user nova-compute[71354]:   </devices>
Apr 13 17:59:28 user nova-compute[71354]: </domain>
Apr 13 17:59:28 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1049189686',display_name='tempest-AttachVolumeTestJSON-server-1049189686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1049189686',id=30,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+YgyiVk19kdaRjmu/uchZVpegteCHORgIR7ZHx/HQsZEpme4M4xwCCZxpEapxFRZcdjPYDWFEZ6h5hweGRRJKYFR156zpNQbuH12loKVtDCwW2nHgO6zKHfJTAmpolhw==',key_name='tempest-keypair-1877620197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-2l0f1td6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=3137ec3f-cb47-4ec9-8321-c6a2486633e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG os_vif [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd86c3ad7-5e, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd86c3ad7-5e, col_values=(('external_ids', {'iface-id': 'd86c3ad7-5ef2-4356-9a80-5bcf35099658', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:2d:6f', 'vm-uuid': '3137ec3f-cb47-4ec9-8321-c6a2486633e1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:28 user nova-compute[71354]: INFO os_vif [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e')
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No VIF found with MAC fa:16:3e:6c:2d:6f, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updated VIF entry in instance network info cache for port d86c3ad7-5ef2-4356-9a80-5bcf35099658. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating instance_info_cache with network_info: [{"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b4c864ec-0606-4603-b2eb-409439a72f25 req-572c0bdc-7bf5-4214-a7bc-4877925c8231 service nova] Releasing lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:29 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] No waiting events found dispatching network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:29 user nova-compute[71354]: WARNING nova.compute.manager [req-f3d4f176-f939-4a36-bd62-aaf691520ad6 req-d8cfabfd-e954-4500-b448-4370e7397078 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received unexpected event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance with vm_state building and task_state spawning.
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:30 user nova-compute[71354]: INFO nova.compute.manager [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Terminating instance
Apr 13 17:59:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-f293d53c-8a46-4ef6-b87f-acbe29c0a760 req-c46aa0de-a38f-4578-bc23-1d4405407138 service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-unplugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:59:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Instance destroyed successfully.
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid 08984ef0-6db9-4a60-b5b9-a6325ec531b1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1478412498',display_name='tempest-ServerActionsTestJSON-server-127366011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1478412498',id=3,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-5q5zb9xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=08984ef0-6db9-4a60-b5b9-a6325ec531b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "067fbe09-ace1-4188-a99f-ee4847a1a311", "address": "fa:16:3e:78:5c:7c", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067fbe09-ac", "ovs_interfaceid": "067fbe09-ace1-4188-a99f-ee4847a1a311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_vif [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067fbe09-ac, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:59:31 user nova-compute[71354]: INFO os_vif [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=067fbe09-ace1-4188-a99f-ee4847a1a311,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067fbe09-ac')
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVlrLEtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:59:31 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eed40f-70e1-49cb-aa9a-8f34eda2a664]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:59:31 user nova-compute[71354]: No targets found.
Apr 13 17:59:31 user nova-compute[71354]: iSNS:
Apr 13 17:59:31 user nova-compute[71354]: No targets found.
Apr 13 17:59:31 user nova-compute[71354]: STATIC:
Apr 13 17:59:31 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 17:59:31 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:59:31 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:59:31 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555
Apr 13 17:59:31 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:59:31 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:59:31 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba
Apr 13 17:59:31 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:59:31 user nova-compute[71354]:                 Iface Name: default
Apr 13 17:59:31 user nova-compute[71354]: FIRMWARE:
Apr 13 17:59:31 user nova-compute[71354]: No targets found.
Apr 13 17:59:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:59:31 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:59:31 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3ce56-3fc1-445c-9068-d383331e8424]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab96f7f-da6f-4241-9e29-f42ee39bdc80]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:59:31 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:59:31 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 17:59:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 17:59:31 user nova-compute[71354]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba (non-flash)
Apr 13 17:59:31 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 17:59:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc3c80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c574caf-1b38-4e60-8894-6f3dfb4f21a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f368f8a-e85d-4755-8ea1-ae5fe85fd34d]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a199ef-d7b3-4b73-b546-69562c606d1f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f19611-d335-4663-bcb1-398de6a73c6d]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd9c3b-2c8a-49a6-8257-6cc1d0796d3a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e40e91-a2cd-4229-b406-a54ab21fd55e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260]
Apr 13 17:59:31 user nova-compute[71354]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba, portal: 172.16.0.220,3260] successful.
Apr 13 17:59:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc848d65-78d3-466f-9c07-311725e1d7ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e7d317-365a-47c8-b605-2519e8aae153]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (359ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:59:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Deleting instance files /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_del
Apr 13 17:59:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Deletion of /opt/stack/data/nova/instances/08984ef0-6db9-4a60-b5b9-a6325ec531b1_del complete
Apr 13 17:59:31 user nova-compute[71354]: INFO nova.compute.manager [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Took 1.44 seconds to destroy the instance on the hypervisor.
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] No waiting events found dispatching network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:31 user nova-compute[71354]: WARNING nova.compute.manager [req-8611d947-5b29-4cde-b85d-ea41d6be75a0 req-90f3ac2b-3d67-4fcf-b2d4-17f98f6a9402 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received unexpected event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance with vm_state building and task_state spawning.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408772.0532892, 3137ec3f-cb47-4ec9-8321-c6a2486633e1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] VM Resumed (Lifecycle Event)
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Instance spawned successfully.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408772.0547392, 3137ec3f-cb47-4ec9-8321-c6a2486633e1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] VM Started (Lifecycle Event)
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Took 6.70 seconds to build instance.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2d7d66fd-b696-41ef-8cd5-6a085596dfe0 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.807s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:32 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Took 0.92 seconds to deallocate network for instance.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Acquiring lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] No waiting events found dispatching network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:32 user nova-compute[71354]: WARNING nova.compute.manager [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received unexpected event network-vif-plugged-067fbe09-ace1-4188-a99f-ee4847a1a311 for instance with vm_state active and task_state deleting.
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-4afbc545-0b5c-4ae8-8db6-e1a285b06040 req-3d0d9a4c-f4b5-4db9-a08a-639e7ecbc5ea service nova] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Received event network-vif-deleted-067fbe09-ace1-4188-a99f-ee4847a1a311 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-changed-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing instance network info cache due to event network-changed-af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:59:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing network info cache for port af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:59:33 user nova-compute[71354]: INFO nova.compute.manager [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Took 0.86 seconds to detach 1 volumes for instance.
Apr 13 17:59:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updated VIF entry in instance network info cache for port af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1e4535-8cfc-461f-bd38-3bbda75473d0 req-6748e16c-0650-407a-be7d-87258369ef7b service nova] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:59:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:33 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Deleted allocations for instance 08984ef0-6db9-4a60-b5b9-a6325ec531b1
Apr 13 17:59:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-33a09989-0f81-4886-b32d-16abd0e95675 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "08984ef0-6db9-4a60-b5b9-a6325ec531b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.862s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:35 user nova-compute[71354]: INFO nova.compute.manager [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Shelving
Apr 13 17:59:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:35 user nova-compute[71354]: WARNING nova.compute.manager [req-3105e35e-50d9-401b-b519-5a9edc880646 req-29ba7053-fda6-41ef-8961-869c48588635 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state active and task_state shelving.
Apr 13 17:59:36 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance destroyed successfully.
Apr 13 17:59:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:36 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Beginning cold snapshot process
Apr 13 17:59:36 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:59:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk /opt/stack/data/nova/instances/snapshots/tmpf55z47__/1767ff5432dd4dab867f0171324baccd {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk /opt/stack/data/nova/instances/snapshots/tmpf55z47__/1767ff5432dd4dab867f0171324baccd" returned: 0 in 0.455s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:36 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Snapshot extracted, beginning image upload
Apr 13 17:59:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:37 user nova-compute[71354]: DEBUG nova.compute.manager [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:37 user nova-compute[71354]: WARNING nova.compute.manager [req-afbbf9a7-4023-4e3e-b111-e81d7c1ccdbb req-c4e10836-a84a-4522-84c5-4d44cbe8b22c service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 17:59:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Snapshot image upload complete
Apr 13 17:59:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:38 user nova-compute[71354]: INFO nova.compute.manager [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Shelve offloading
Apr 13 17:59:39 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance destroyed successfully.
Apr 13 17:59:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:59:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:59:39 user nova-compute[71354]: DEBUG nova.network.neutron [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:59:39 user nova-compute[71354]: DEBUG nova.network.neutron [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:59:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance destroyed successfully.
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'resources' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZyKsU5d3bmL/UYx8WaLL5HbYx/LyhlGbrsQ08rU0/9ERgJOpMA/oSP5ygT2oWoSAVJJWq6FEawBSbz8eCp+eykT1Y1DqGMQv/islvnWWLiXrHaPJ09U0W9Wfw/KjAghA==',key_name='tempest-keypair-91694189',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:59:38.921881',shelved_host='user',shelved_image_id='92f9c415-41e9-43d8-9bf8-c1610841b0ba'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG os_vif [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf96f300-94, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-changed-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing instance network info cache due to event network-changed-af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing network info cache for port af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:59:40 user nova-compute[71354]: INFO os_vif [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94')
Apr 13 17:59:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Deleting instance files /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a_del
Apr 13 17:59:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Deletion of /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a_del complete
Apr 13 17:59:40 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Deleted allocations for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'numa_topology' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updated VIF entry in instance network info cache for port af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaf96f300-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2244ed91-7d08-4908-93a4-bbcf57a09481 req-7f2f0535-9c19-4a3a-8d52-9a5114644743 service nova] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-26d65df3-e2d0-445b-9749-11c3fec30355 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.448s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:46 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408771.0744917, 08984ef0-6db9-4a60-b5b9-a6325ec531b1 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:59:46 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] VM Stopped (Lifecycle Event)
Apr 13 17:59:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-23e49576-db57-4d30-8d1a-7668168d3cff None None] [instance: 08984ef0-6db9-4a60-b5b9-a6325ec531b1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:50 user nova-compute[71354]: INFO nova.compute.manager [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Terminating instance
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-unplugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] No waiting events found dispatching network-vif-unplugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-24d999cf-91ec-4962-afd6-17f8220e4c0c req-88eca470-7a1a-4c78-85e5-5cd3756080fb service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-unplugged-054e541d-7046-460e-b183-8ea6906af1e0 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:59:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Instance destroyed successfully.
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lazy-loading 'resources' on Instance uuid 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2112694815',display_name='tempest-VolumesNegativeTest-instance-2112694815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2112694815',id=25,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='896d3c28f5394d338751e9760b2bf797',ramdisk_id='',reservation_id='r-ppap0i0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1324976558',owner_user_name='tempest-VolumesNegativeTest-1324976558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:58:07Z,user_data=None,user_id='c7a49ea3332547cbb44e26d070ac91b6',uuid=75eb1a09-48f8-4689-bd5e-9234ec6ac2f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converting VIF {"id": "054e541d-7046-460e-b183-8ea6906af1e0", "address": "fa:16:3e:ca:a6:96", "network": {"id": "6bc13931-c639-4040-b6a7-ffe1c25d3040", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "43c59a7049124424abda63ea885430c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054e541d-70", "ovs_interfaceid": "054e541d-7046-460e-b183-8ea6906af1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG os_vif [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap054e541d-70, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:50 user nova-compute[71354]: INFO os_vif [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a6:96,bridge_name='br-int',has_traffic_filtering=True,id=054e541d-7046-460e-b183-8ea6906af1e0,network=Network(6bc13931-c639-4040-b6a7-ffe1c25d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054e541d-70')
Apr 13 17:59:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Deleting instance files /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8_del
Apr 13 17:59:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Deletion of /opt/stack/data/nova/instances/75eb1a09-48f8-4689-bd5e-9234ec6ac2f8_del complete
Apr 13 17:59:50 user nova-compute[71354]: INFO nova.compute.manager [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 13 17:59:50 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:59:50 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408776.0412288, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:59:51 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Stopped (Lifecycle Event)
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-da42a95a-d003-4242-bc6f-6fa91e8ed5cb None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:59:51 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Took 0.46 seconds to deallocate network for instance.
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-4b12dab3-fd3b-42bb-a1b9-f84687ef5057 req-41435fe2-315d-4459-902f-24db55a80ebf service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-deleted-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:51 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Deleted allocations for instance 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8
Apr 13 17:59:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-31da155f-6f2d-474d-bd52-da50677d582c tempest-VolumesNegativeTest-1324976558 tempest-VolumesNegativeTest-1324976558-project-member] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Acquiring lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] Lock "75eb1a09-48f8-4689-bd5e-9234ec6ac2f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] No waiting events found dispatching network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:59:52 user nova-compute[71354]: WARNING nova.compute.manager [req-29c7013c-a202-472e-9c4a-9df120129868 req-b20f5c07-5b2d-4fa5-a517-6b6a6ef9fd96 service nova] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Received unexpected event network-vif-plugged-054e541d-7046-460e-b183-8ea6906af1e0 for instance with vm_state deleted and task_state None.
Apr 13 17:59:54 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:54 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:54 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:59:58 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:59:58 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=26.077796936035156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance a594110c-a772-408d-8650-b5f2ab1e5f56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:59:58 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:59:59 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:59:59 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:59:59 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:59:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:00:01 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:02 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:00:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:04 user nova-compute[71354]: INFO nova.compute.manager [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] instance snapshotting
Apr 13 18:00:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Beginning live snapshot process
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json -f qcow2 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da.delta 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da.delta 1073741824" returned: 0 in 0.063s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 18:00:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:00:05 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408790.8422413, 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:05 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] VM Stopped (Lifecycle Event)
Apr 13 18:00:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7ec0d87c-53f5-4e51-80a5-980f7fa892cc None None] [instance: 75eb1a09-48f8-4689-bd5e-9234ec6ac2f8] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71354) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:00:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 18:00:06 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:00:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da.delta /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da.delta /opt/stack/data/nova/instances/snapshots/tmp7nxcjmke/fa57709cd644446f9474f0fa7d7351da" returned: 0 in 0.235s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:06 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Snapshot extracted, beginning image upload
Apr 13 18:00:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:08 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Snapshot image upload complete
Apr 13 18:00:08 user nova-compute[71354]: INFO nova.compute.manager [None req-2a48b7df-d188-4c92-94d0-c1fa65d16840 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Took 4.30 seconds to snapshot the instance on the hypervisor.
Apr 13 18:00:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:13 user nova-compute[71354]: INFO nova.compute.manager [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Terminating instance
Apr 13 18:00:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-unplugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] No waiting events found dispatching network-vif-unplugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-193f306a-c3a5-4ecd-ab70-2f2331e0ee2f req-57cf3093-e857-4908-9ebc-3e54d5482a05 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-unplugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Instance destroyed successfully.
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid a594110c-a772-408d-8650-b5f2ab1e5f56 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778851942',display_name='tempest-TestVolumeBootPattern-server-1778851942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778851942',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-0kh9noz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:58:42Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=a594110c-a772-408d-8650-b5f2ab1e5f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "address": "fa:16:3e:26:3a:fa", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87dbfc1-17", "ovs_interfaceid": "d87dbfc1-17d9-42b9-8713-eb1a2ee329a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_vif [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd87dbfc1-17, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:00:14 user nova-compute[71354]: INFO os_vif [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3a:fa,bridge_name='br-int',has_traffic_filtering=True,id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87dbfc1-17')
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwGNMQYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:14 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf75fea-4c2f-4dc8-b14f-f1235f4111b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:00:14 user nova-compute[71354]: No targets found.
Apr 13 18:00:14 user nova-compute[71354]: iSNS:
Apr 13 18:00:14 user nova-compute[71354]: No targets found.
Apr 13 18:00:14 user nova-compute[71354]: STATIC:
Apr 13 18:00:14 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:00:14 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:00:14 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:00:14 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555
Apr 13 18:00:14 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:00:14 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:00:14 user nova-compute[71354]: FIRMWARE:
Apr 13 18:00:14 user nova-compute[71354]: No targets found.
Apr 13 18:00:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:00:14 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:00:14 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62ad53-d746-4b63-82a4-cd0287a317a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ecbae-68d4-4ca9-878e-4d2fbcac6928]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:14 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 18:00:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:14 user nova-compute[71354]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 (non-flash)
Apr 13 18:00:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d44a37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a4f60-cb2d-4222-944f-a35dc7cb2ee4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb1e9e-f039-4585-bf6f-ff8c8970a3c6]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62771b4-3c88-455b-933e-dc1df1127efb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e19ac-5212-47a1-ae02-079ddf622f42]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26432363233613165', '/dev/disk/by-id/scsi-1SCST_BIO24c5621e-d2623a1e85d58351', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_24c5621e') {{(pid=81468) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 18:00:14 user nova-compute[71354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO24c5621e-d2623a1e85d58351
Apr 13 18:00:14 user nova-compute[71354]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_24c5621e
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0858bc4e-4b33-4088-9f95-d321f1ba4dd0]: (4, None) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5574030a-610e-4098-87f1-911e407c36eb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae6686-2683-493e-82d4-0f52fdb9db23]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260]
Apr 13 18:00:14 user nova-compute[71354]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555, portal: 172.16.0.220,3260] successful.
Apr 13 18:00:14 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[89590ff0-1e60-4764-863c-e5891fdd3157]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (313ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Deleting instance files /opt/stack/data/nova/instances/a594110c-a772-408d-8650-b5f2ab1e5f56_del
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Deletion of /opt/stack/data/nova/instances/a594110c-a772-408d-8650-b5f2ab1e5f56_del complete
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.compute.manager [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 18:00:14 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Took 0.45 seconds to deallocate network for instance.
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-deleted-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:14 user nova-compute[71354]: INFO nova.compute.manager [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Neutron deleted interface d87dbfc1-17d9-42b9-8713-eb1a2ee329a3; detaching it from the instance and deleting it from the info cache
Apr 13 18:00:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-677b2964-e5f1-4aaa-a7a7-ed83e28e4afc req-4c327db7-2d0d-43e8-9b2a-8b19f2870eb1 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Detach interface failed, port_id=d87dbfc1-17d9-42b9-8713-eb1a2ee329a3, reason: Instance a594110c-a772-408d-8650-b5f2ab1e5f56 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Acquiring lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] No waiting events found dispatching network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:15 user nova-compute[71354]: WARNING nova.compute.manager [req-70384393-79f7-44b1-a507-86b46eb46547 req-636e136c-3ebc-4bf1-a48b-778e4f1d8f49 service nova] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Received unexpected event network-vif-plugged-d87dbfc1-17d9-42b9-8713-eb1a2ee329a3 for instance with vm_state active and task_state deleting.
Apr 13 18:00:15 user nova-compute[71354]: INFO nova.compute.manager [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Took 0.78 seconds to detach 1 volumes for instance.
Apr 13 18:00:15 user nova-compute[71354]: DEBUG nova.compute.manager [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Deleting volume: d4de66cb-c6a3-4c38-9a6b-13e4f4d61555 {{(pid=71354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:00:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:00:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:16 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance a594110c-a772-408d-8650-b5f2ab1e5f56
Apr 13 18:00:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-c6c8e21d-cb35-4406-ad6c-c43e98ac8162 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "a594110c-a772-408d-8650-b5f2ab1e5f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:00:21 user nova-compute[71354]: INFO nova.compute.claims [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Claim successful on node user
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:00:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.policy [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:00:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Creating image(s)
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "/opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "/opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk 1073741824" returned: 0 in 0.046s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:00:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Cannot resize image /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'migration_context' on Instance uuid b75d41c6-6cf6-4162-b49b-c3205c128ef4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Successfully created port: 54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Ensure instance console log exists: /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Successfully updated port: 54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing instance network info cache due to event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Acquiring lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Instance network_info: |[{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Acquired lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Start _get_guest_xml network_info=[{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:00:24 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:00:24 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-935220888',display_name='tempest-ServerActionsTestJSON-server-935220888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-935220888',id=31,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-806pct33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=b75d41c6-6cf6-4162-b49b-c3205c128ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.objects.instance [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid b75d41c6-6cf6-4162-b49b-c3205c128ef4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:00:24 user nova-compute[71354]:   <uuid>b75d41c6-6cf6-4162-b49b-c3205c128ef4</uuid>
Apr 13 18:00:24 user nova-compute[71354]:   <name>instance-0000001f</name>
Apr 13 18:00:24 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:00:24 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:00:24 user nova-compute[71354]:   <metadata>
Apr 13 18:00:24 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:00:24 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-935220888</nova:name>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:00:24</nova:creationTime>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:00:24 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:00:24 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:owner>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 18:00:24 user nova-compute[71354]:       </nova:owner>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:00:24 user nova-compute[71354]:       <nova:ports>
Apr 13 18:00:24 user nova-compute[71354]:         <nova:port uuid="54109c72-9d87-44b7-a358-864c31b9c96d">
Apr 13 18:00:24 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 18:00:24 user nova-compute[71354]:         </nova:port>
Apr 13 18:00:24 user nova-compute[71354]:       </nova:ports>
Apr 13 18:00:24 user nova-compute[71354]:     </nova:instance>
Apr 13 18:00:24 user nova-compute[71354]:   </metadata>
Apr 13 18:00:24 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:00:24 user nova-compute[71354]:     <system>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="serial">b75d41c6-6cf6-4162-b49b-c3205c128ef4</entry>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="uuid">b75d41c6-6cf6-4162-b49b-c3205c128ef4</entry>
Apr 13 18:00:24 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:00:24 user nova-compute[71354]:     </system>
Apr 13 18:00:24 user nova-compute[71354]:   </sysinfo>
Apr 13 18:00:24 user nova-compute[71354]:   <os>
Apr 13 18:00:24 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:00:24 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:00:24 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:00:24 user nova-compute[71354]:   </os>
Apr 13 18:00:24 user nova-compute[71354]:   <features>
Apr 13 18:00:24 user nova-compute[71354]:     <acpi/>
Apr 13 18:00:24 user nova-compute[71354]:     <apic/>
Apr 13 18:00:24 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:00:24 user nova-compute[71354]:   </features>
Apr 13 18:00:24 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:00:24 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:00:24 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:00:24 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:00:24 user nova-compute[71354]:   </clock>
Apr 13 18:00:24 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:00:24 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:00:24 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:00:24 user nova-compute[71354]:   </cpu>
Apr 13 18:00:24 user nova-compute[71354]:   <devices>
Apr 13 18:00:24 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:00:24 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:00:24 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk"/>
Apr 13 18:00:24 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:00:24 user nova-compute[71354]:     </disk>
Apr 13 18:00:24 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:00:24 user nova-compute[71354]:       <mac address="fa:16:3e:a1:40:55"/>
Apr 13 18:00:24 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:00:24 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:00:24 user nova-compute[71354]:       <target dev="tap54109c72-9d"/>
Apr 13 18:00:24 user nova-compute[71354]:     </interface>
Apr 13 18:00:24 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:00:24 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/console.log" append="off"/>
Apr 13 18:00:24 user nova-compute[71354]:     </serial>
Apr 13 18:00:24 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:00:24 user nova-compute[71354]:     <video>
Apr 13 18:00:24 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:00:24 user nova-compute[71354]:     </video>
Apr 13 18:00:24 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:00:24 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:00:24 user nova-compute[71354]:     </rng>
Apr 13 18:00:24 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:00:24 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:00:24 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:00:24 user nova-compute[71354]:     </memballoon>
Apr 13 18:00:24 user nova-compute[71354]:   </devices>
Apr 13 18:00:24 user nova-compute[71354]: </domain>
Apr 13 18:00:24 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-935220888',display_name='tempest-ServerActionsTestJSON-server-935220888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-935220888',id=31,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-806pct33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=b75d41c6-6cf6-4162-b49b-c3205c128ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG os_vif [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54109c72-9d, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54109c72-9d, col_values=(('external_ids', {'iface-id': '54109c72-9d87-44b7-a358-864c31b9c96d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:40:55', 'vm-uuid': 'b75d41c6-6cf6-4162-b49b-c3205c128ef4'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:24 user nova-compute[71354]: INFO os_vif [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d')
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:a1:40:55, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updated VIF entry in instance network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:00:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e8d68fb-673d-400f-a5b6-e9c297e3e9fd req-df71d8a2-9218-48b0-9c90-71e5aa1f1532 service nova] Releasing lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing instance network info cache due to event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Acquiring lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Acquired lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing network info cache for port a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:26 user nova-compute[71354]: INFO nova.compute.manager [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Attaching volume 008f5615-748c-4a5f-9e50-db5b9f3aad89 to /dev/vdb
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.utils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ee1291-5716-4041-8640-88c28c1b80ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274c16e-8095-4793-81a6-9b45f5687d7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updated VIF entry in instance network info cache for port a494221d-1460-48b2-9a60-b2329efbf6bc. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating instance_info_cache with network_info: [{"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e832328-db01-4300-8e20-a68f4b7fcb12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ee5a5-8f36-4ef1-8109-b4dc54edf2aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d992095f-f20e-46f8-9202-c8b74957c1e1 req-0c026a3a-a9d8-4fc1-a013-e36c4a1cdbac service nova] Releasing lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:00:26 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[360fc23b-1f9a-480a-826e-6bc7ea6f47aa]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG os_brick.utils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating existing volume attachment record: 849e6896-0237-4736-a9de-c3261bc857f9 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] No waiting events found dispatching network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:26 user nova-compute[71354]: WARNING nova.compute.manager [req-b502804b-912e-4e39-bb17-53965a885ff5 req-48b49ffd-89b9-4342-9aad-62af0682fe36 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received unexpected event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d for instance with vm_state building and task_state spawning.
Apr 13 18:00:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] No waiting events found dispatching network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:28 user nova-compute[71354]: WARNING nova.compute.manager [req-086e71d8-61c3-4c5d-a8ee-008e3258beae req-571daa9f-485d-4f2b-a9ac-7f31c86dc203 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received unexpected event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d for instance with vm_state building and task_state spawning.
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408828.3924105, b75d41c6-6cf6-4162-b49b-c3205c128ef4 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] VM Resumed (Lifecycle Event)
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Instance spawned successfully.
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408828.3940637, b75d41c6-6cf6-4162-b49b-c3205c128ef4 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] VM Started (Lifecycle Event)
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 13 18:00:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:28 user nova-compute[71354]: INFO nova.compute.manager [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Took 6.73 seconds to build instance.
Apr 13 18:00:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-19407993-d770-4598-86e0-52e2a7b23bd6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.825s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:29 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408814.080116, a594110c-a772-408d-8650-b5f2ab1e5f56 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:29 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] VM Stopped (Lifecycle Event)
Apr 13 18:00:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-97cf8b20-1513-414f-8c30-bf5d8090a7e2 None None] [instance: a594110c-a772-408d-8650-b5f2ab1e5f56] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrgmZXTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:30 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ffc0d-4e0b-49ba-8a08-826f561ecd90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:00:30 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a82787-137a-43c0-9dfa-143e82d6ae75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89] added
Apr 13 18:00:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621ebe2-e9da-4798-aeaa-1ee6f1e73913]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea8bcde-bae4-439d-9ee2-71d9c130595e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrgmZXTS {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrgmZXTS" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ce8a7-652b-4109-a8f3-21699ed19d57]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrgmZXTS'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[01403649-6994-4311-ab22-0d2e1dea2261]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476465c-bd0a-4d15-8e10-12fb58429ee0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab69101b-6f87-4668-9854-504c4035adaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260]
Apr 13 18:00:31 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260] successful.
Apr 13 18:00:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[373af4ef-fd25-49e2-a545-7926b8c6a1d8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[088eb0a1-57be-48f4-b383-53ec78e5e3bc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)
Apr 13 18:00:31 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f38b48e-70c3-4818-a155-e903f17f4e1b]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:00:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrgmZXTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23132383763393334', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383763393334', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.objects.instance [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:00:32 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:00:32 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:00:32 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:00:32 user nova-compute[71354]:   <serial>008f5615-748c-4a5f-9e50-db5b9f3aad89</serial>
Apr 13 18:00:32 user nova-compute[71354]: </disk>
Apr 13 18:00:32 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing instance network info cache due to event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.network.neutron [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.objects.instance [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] No VIF found with MAC fa:16:3e:1d:f0:45, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:32 user nova-compute[71354]: INFO nova.compute.manager [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Attaching volume c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b to /dev/vdb
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-579c06df-6a5d-4549-ad1a-b32efa69dc36 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.937s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ebd11-12a7-4dda-9503-702fa88a5fec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e3f76-5ee0-4452-9837-5bf3716ce71d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e0598c-f442-410c-a88d-a00c1474a2a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941014c-6c8d-4119-858a-6b7cf2193908]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:00:33 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c1d35-d653-4697-ad06-3e622ed10ce5]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating existing volume attachment record: 36bd1954-bdcb-4747-b9d1-d9c91fe234ab {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updated VIF entry in instance network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-daefed8e-5638-487c-acf2-79bddf0b18d9 req-9d442794-24db-4242-aebe-4f57989815b9 service nova] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:34 user nova-compute[71354]: INFO nova.compute.manager [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Detaching volume 008f5615-748c-4a5f-9e50-db5b9f3aad89
Apr 13 18:00:34 user nova-compute[71354]: INFO nova.virt.block_device [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Attempting to driver detach volume 008f5615-748c-4a5f-9e50-db5b9f3aad89 from mountpoint /dev/vdb
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Attempting to detach device vdb from instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:00:34 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:00:34 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:00:34 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:00:34 user nova-compute[71354]:   <serial>008f5615-748c-4a5f-9e50-db5b9f3aad89</serial>
Apr 13 18:00:34 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:00:34 user nova-compute[71354]: </disk>
Apr 13 18:00:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:00:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully detached device vdb from instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 from the persistent domain config.
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:00:34 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:00:34 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:00:34 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:00:34 user nova-compute[71354]:   <serial>008f5615-748c-4a5f-9e50-db5b9f3aad89</serial>
Apr 13 18:00:34 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:00:34 user nova-compute[71354]: </disk>
Apr 13 18:00:34 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408834.783511, 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:00:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully detached device vdb from instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 from the live domain config.
Apr 13 18:00:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrgmZXTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:34 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[958012f0-143a-49b5-b6a6-4deeff3427d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:00:34 user nova-compute[71354]: No targets found.
Apr 13 18:00:34 user nova-compute[71354]: iSNS:
Apr 13 18:00:34 user nova-compute[71354]: No targets found.
Apr 13 18:00:34 user nova-compute[71354]: STATIC:
Apr 13 18:00:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89
Apr 13 18:00:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:00:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:00:34 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:00:34 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:00:34 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:00:34 user nova-compute[71354]: FIRMWARE:
Apr 13 18:00:34 user nova-compute[71354]: No targets found.
Apr 13 18:00:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:00:34 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:00:34 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93144304-4be8-4ac8-9b9b-2552e22e28aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078bceb-bde2-4e0c-830e-21bfd7f79b90]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:34 user nova-compute[71354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)
Apr 13 18:00:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:34 user nova-compute[71354]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 (non-flash)
Apr 13 18:00:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d46512d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ed263-c2d4-4c78-9fae-2ea10c0c508e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8d9ab3-1cf8-4cc1-baf0-5ac0a439ac82]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3186301d-8560-4039-b76f-6292b443eb96]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dbadd4-cdc4-4597-8a1b-e576319ff763]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cffeb5-7770-494e-9397-55e30e67a821]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef76503d-c53e-46cd-831b-5da0710e32f1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260]
Apr 13 18:00:35 user nova-compute[71354]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89, portal: 172.16.0.220,3260] successful.
Apr 13 18:00:35 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008f5615-748c-4a5f-9e50-db5b9f3aad89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce507f1-be7d-4827-8e2e-b43582e6251f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] <== disconnect_volume: return (340ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'flavor' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ded0c607-6131-4597-b929-eec42a746a7c tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxyFJHnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:00:39 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:39 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:00:39 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[700af021-e0e4-4e38-93f7-02918f41dcc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:00:39 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2440326d-7978-4f83-9a87-c12fceb4b60a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b] added
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80659f-116e-4dc7-817c-f53924ca6bb3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec17ad-dbac-40c6-a2f3-a43291a4102c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxyFJHnj {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxyFJHnj" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed256b-2550-4514-b5ed-133afdc8f750]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rxyFJHnj'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58952dd-a36b-4531-91b7-c49908b340bf]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d1f2f-cb10-46ad-b834-eea16a031ffa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ba3b7-6fcb-46bc-ada6-e250ec91492b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260]
Apr 13 18:00:39 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260] successful.
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683fe67-3fbe-4d12-956b-869e2ae948b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4995443-616c-42c4-9974-e8280b68d524]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:39 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:00:39 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:00:39 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9676ca03-9077-4385-8dbe-dff3577d5073]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:00:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxyFJHnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:00:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:00:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26630656639323133', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:00:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630656639323133', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:00:40 user nova-compute[71354]: DEBUG nova.objects.instance [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:00:40 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:00:40 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:00:40 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:00:40 user nova-compute[71354]:   <serial>c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b</serial>
Apr 13 18:00:40 user nova-compute[71354]: </disk>
Apr 13 18:00:40 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:34:d0:51, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-04ae0e70-375e-4263-aa21-a8f38f7ce9ca tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.291s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:41 user nova-compute[71354]: INFO nova.compute.manager [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Rescuing
Apr 13 18:00:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:00:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:42 user nova-compute[71354]: WARNING nova.compute.manager [req-b9878849-f459-486c-bc21-844dc500893b req-cc40caf5-26cb-41ba-8b28-b385ddf1bbe2 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state active and task_state rescuing.
Apr 13 18:00:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance destroyed successfully.
Apr 13 18:00:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Attempting rescue
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 18:00:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Creating image(s)
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue" returned: 0 in 0.048s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'migration_context' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start _get_guest_xml network_info=[{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:34:d0:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'numa_topology' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:00:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-320463142',display_name='tempest-ServerRescueNegativeTestJSON-server-320463142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-320463142',id=29,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBsAPFHL1kEqtOmPsrJKB5vYho0rsY7MM2yfOo6HwS5Wp/30YJfBntr9RLJhPsW7Wt1wJtGkjLqIJ5RG3sY6B0IKcGOd0soxtl42k1xZK+fo8pt+njadFWbmK0xi8LMQ==',key_name='tempest-keypair-1158147748',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:58:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-g7yn0ebl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=dd2b2a73-ff8a-4357-bad3-6be8fd95b374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:34:d0:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "vif_mac": "fa:16:3e:34:d0:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'pci_devices' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:00:43 user nova-compute[71354]:   <uuid>dd2b2a73-ff8a-4357-bad3-6be8fd95b374</uuid>
Apr 13 18:00:43 user nova-compute[71354]:   <name>instance-0000001d</name>
Apr 13 18:00:43 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:00:43 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:00:43 user nova-compute[71354]:   <metadata>
Apr 13 18:00:43 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:00:43 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-320463142</nova:name>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:00:43</nova:creationTime>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:00:43 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:00:43 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:owner>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:user uuid="8f1fe2e6fd894d5c87d7ccf5fae553ca">tempest-ServerRescueNegativeTestJSON-766015461-project-member</nova:user>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:project uuid="c97ac3ae1ebe4107a05bd27710b9502b">tempest-ServerRescueNegativeTestJSON-766015461</nova:project>
Apr 13 18:00:43 user nova-compute[71354]:       </nova:owner>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:00:43 user nova-compute[71354]:       <nova:ports>
Apr 13 18:00:43 user nova-compute[71354]:         <nova:port uuid="2eab9a6c-32a8-4811-8005-1b4f1a6642f1">
Apr 13 18:00:43 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 18:00:43 user nova-compute[71354]:         </nova:port>
Apr 13 18:00:43 user nova-compute[71354]:       </nova:ports>
Apr 13 18:00:43 user nova-compute[71354]:     </nova:instance>
Apr 13 18:00:43 user nova-compute[71354]:   </metadata>
Apr 13 18:00:43 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:00:43 user nova-compute[71354]:     <system>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="serial">dd2b2a73-ff8a-4357-bad3-6be8fd95b374</entry>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="uuid">dd2b2a73-ff8a-4357-bad3-6be8fd95b374</entry>
Apr 13 18:00:43 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:00:43 user nova-compute[71354]:     </system>
Apr 13 18:00:43 user nova-compute[71354]:   </sysinfo>
Apr 13 18:00:43 user nova-compute[71354]:   <os>
Apr 13 18:00:43 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:00:43 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:00:43 user nova-compute[71354]:   </os>
Apr 13 18:00:43 user nova-compute[71354]:   <features>
Apr 13 18:00:43 user nova-compute[71354]:     <acpi/>
Apr 13 18:00:43 user nova-compute[71354]:     <apic/>
Apr 13 18:00:43 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:00:43 user nova-compute[71354]:   </features>
Apr 13 18:00:43 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:00:43 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:00:43 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:00:43 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:00:43 user nova-compute[71354]:   </clock>
Apr 13 18:00:43 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:00:43 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:00:43 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:00:43 user nova-compute[71354]:   </cpu>
Apr 13 18:00:43 user nova-compute[71354]:   <devices>
Apr 13 18:00:43 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:00:43 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:00:43 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue"/>
Apr 13 18:00:43 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:00:43 user nova-compute[71354]:     </disk>
Apr 13 18:00:43 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:00:43 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:00:43 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk"/>
Apr 13 18:00:43 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 18:00:43 user nova-compute[71354]:     </disk>
Apr 13 18:00:43 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:00:43 user nova-compute[71354]:       <mac address="fa:16:3e:34:d0:51"/>
Apr 13 18:00:43 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:00:43 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:00:43 user nova-compute[71354]:       <target dev="tap2eab9a6c-32"/>
Apr 13 18:00:43 user nova-compute[71354]:     </interface>
Apr 13 18:00:43 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:00:43 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/console.log" append="off"/>
Apr 13 18:00:43 user nova-compute[71354]:     </serial>
Apr 13 18:00:43 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:00:43 user nova-compute[71354]:     <video>
Apr 13 18:00:43 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:00:43 user nova-compute[71354]:     </video>
Apr 13 18:00:43 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:00:43 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:00:43 user nova-compute[71354]:     </rng>
Apr 13 18:00:43 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:00:43 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:00:43 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:00:43 user nova-compute[71354]:     </memballoon>
Apr 13 18:00:43 user nova-compute[71354]:   </devices>
Apr 13 18:00:43 user nova-compute[71354]: </domain>
Apr 13 18:00:43 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:00:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance destroyed successfully.
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:00:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] No VIF found with MAC fa:16:3e:34:d0:51, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:44 user nova-compute[71354]: WARNING nova.compute.manager [req-10666cf7-8d2c-4eaa-9c93-9e8296c52a3f req-5c31abc8-9753-44ed-bc63-1f1918da023c service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state active and task_state rescuing.
Apr 13 18:00:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:46 user nova-compute[71354]: WARNING nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state active and task_state rescuing.
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:00:46 user nova-compute[71354]: WARNING nova.compute.manager [req-cd612a5a-b26f-4de0-9025-2f7455177bcb req-ab20c974-b009-417f-83db-a1559f7d2906 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state active and task_state rescuing.
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for dd2b2a73-ff8a-4357-bad3-6be8fd95b374 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 18:00:46 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408846.9884515, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Resumed (Lifecycle Event)
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-294fec78-b2b8-43c4-add6-b6532ac28760 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:00:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408846.9986222, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:00:47 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Started (Lifecycle Event)
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:00:47 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:00:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:00:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:00:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:00:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7712MB free_disk=26.009349822998047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:01:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:01:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:01:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [{"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-474af9f8-6700-4288-8133-a8dad4cf8a88" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:01:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:10 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:01:10 user nova-compute[71354]: INFO nova.compute.claims [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Claim successful on node user
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:01:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:01:11 user nova-compute[71354]: INFO nova.virt.block_device [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Booting with volume-backed-image c7f9966b-afb1-42f9-9999-e623e0bf219a at /dev/vda
Apr 13 18:01:11 user nova-compute[71354]: DEBUG nova.policy [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec5fc9c7b7234904ba39d403764420b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd533287b8269447aab81fa7d1312d3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:01:12 user nova-compute[71354]: INFO nova.compute.claims [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Claim successful on node user
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Successfully created port: 8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:01:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:01:12 user nova-compute[71354]: INFO nova.virt.block_device [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Booting with volume 2afce609-7ea7-4958-a9dd-326c20de27a0 at /dev/vda
Apr 13 18:01:12 user nova-compute[71354]: DEBUG nova.policy [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG os_brick.utils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e75ad-795e-41e7-aea5-03bafbdd1bc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e08726-16c0-4d87-85f2-74f6f5dda2d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a9cee-eb2e-4485-b639-d23b27b1aec8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0630e4f-20fe-4100-a7e3-40a543a7b5b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:13 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f0ad1-9289-4a4e-b77e-26f3b95d3d72]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG os_brick.utils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Updating existing volume attachment record: 98fdd7e4-9053-428e-bf69-a6992b2609e2 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Successfully updated port: 8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-changed-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Refreshing instance network info cache due to event network-changed-8931403f-8458-4b81-b911-280a70e1869a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Acquiring lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Successfully created port: 780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating instance_info_cache with network_info: [{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance network_info: |[{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Acquired lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Refreshing network info cache for port 8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updated VIF entry in instance network info cache for port 8931403f-8458-4b81-b911-280a70e1869a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating instance_info_cache with network_info: [{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2d096e55-d2f3-4453-810d-d5f9add7988b req-5d842246-bc2e-4402-bdd5-ac06617e3359 service nova] Releasing lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Successfully updated port: 780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-changed-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Refreshing instance network info cache due to event network-changed-780a9174-8b86-4c52-a264-92a4224ba2a3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Acquiring lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Updating instance_info_cache with network_info: [{"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Instance network_info: |[{"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Acquired lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:15 user nova-compute[71354]: DEBUG nova.network.neutron [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Refreshing network info cache for port 780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Updated VIF entry in instance network info cache for port 780a9174-8b86-4c52-a264-92a4224ba2a3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Updating instance_info_cache with network_info: [{"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a399754d-84b7-4046-a719-215a6be568dc req-b5f9b206-380b-4108-b05d-b6d55ac295ad service nova] Releasing lock "refresh_cache-b35e0e9b-3b18-4ef8-8299-bff7643aaccd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-changed-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Refreshing instance network info cache due to event network-changed-d86c3ad7-5ef2-4356-9a80-5bcf35099658. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Acquiring lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Acquired lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:16 user nova-compute[71354]: DEBUG nova.network.neutron [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Refreshing network info cache for port d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updated VIF entry in instance network info cache for port d86c3ad7-5ef2-4356-9a80-5bcf35099658. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating instance_info_cache with network_info: [{"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12ea5e8d-4caf-4486-b129-04fedff82647 req-7d41c567-7daa-4088-9000-b6264d7d447e service nova] Releasing lock "refresh_cache-3137ec3f-cb47-4ec9-8321-c6a2486633e1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a9cf5-d88d-4316-a76d-552f28ec13e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a056da-b7ef-41e0-8e45-7dac51b44802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe63949-39ca-4b61-a3b0-2578acd35f08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0995e3-943f-444a-b669-c84b3e899a9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:17 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c9600-bdd8-4995-ab79-27a05ee762a3]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating existing volume attachment record: fdc95eb1-16e8-46bb-b281-5f0e25984a57 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:01:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Creating image(s)
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Ensure instance console log exists: /opt/stack/data/nova/instances/b35e0e9b-3b18-4ef8-8299-bff7643aaccd/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Start _get_guest_xml network_info=[{"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '98fdd7e4-9053-428e-bf69-a6992b2609e2', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udoYFwLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b35e0e9b-3b18-4ef8-8299-bff7643aaccd', 'attached_at': '', 'detached_at': '', 'volume_id': '2afce609-7ea7-4958-a9dd-326c20de27a0', 'serial': '2afce609-7ea7-4958-a9dd-326c20de27a0'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:01:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udoYFwLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:17 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:17 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:17 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6876ce-9666-475b-b8a1-6d7d9bf9f0e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:01:17 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6697d2-bc54-48ab-8869-e6233c368584]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0] added
Apr 13 18:01:17 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adde1ae-15fa-490d-8a84-ada3c7844599]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af92ab2-2f66-49f9-b4ce-d2d08345c2a9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udoYFwLp {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udoYFwLp" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[501ecfbe-5c00-41c8-9e85-4ddf954861fd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'udoYFwLp'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413d43a-fc16-45e4-ba91-aa3383db6fe0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a8eb6-f776-4295-b884-f39daf68740c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042e3fe-7e9a-44b7-bffe-d652a28b69ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260]
Apr 13 18:01:18 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a0d32-191c-4c97-b546-402ea3d6ebc9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb81bbd-2f57-4d22-93c4-4c1e5c98720d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:18 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4f3faa-3ca1-4241-8163-36a3b9d26033]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udoYFwLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:18 user nova-compute[71354]: INFO nova.compute.manager [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attaching volume 3b799019-1d16-431b-aba7-8111109ad67d to /dev/vdb
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.utils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef3bbe4-a6c1-4e05-9ac0-6866648123a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[295d09f8-c0b2-4a0a-a002-0254afd79659]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072b8a2-4528-4571-8b86-b081ed2c3507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1ae59-87f5-4481-9617-d411525d5229]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:18 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:01:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0269a8ed-1744-42af-96b7-4f523718ad5d]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG os_brick.utils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:18 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating existing volume attachment record: 59b8f313-8a84-4368-9455-82c9675c3729 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23033353565326166', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033353565326166', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1216519227',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-cp8ianfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:13Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=b35e0e9b-3b18-4ef8-8299-bff7643aaccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.objects.instance [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid b35e0e9b-3b18-4ef8-8299-bff7643aaccd {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:01:19 user nova-compute[71354]:   <uuid>b35e0e9b-3b18-4ef8-8299-bff7643aaccd</uuid>
Apr 13 18:01:19 user nova-compute[71354]:   <name>instance-00000021</name>
Apr 13 18:01:19 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:01:19 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:01:19 user nova-compute[71354]:   <metadata>
Apr 13 18:01:19 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:01:19 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:01:19 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1216519227</nova:name>
Apr 13 18:01:19 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:01:17</nova:creationTime>
Apr 13 18:01:19 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:01:19 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:01:19 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:01:19 user nova-compute[71354]:       <nova:owner>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 18:01:19 user nova-compute[71354]:       </nova:owner>
Apr 13 18:01:19 user nova-compute[71354]:       <nova:ports>
Apr 13 18:01:19 user nova-compute[71354]:         <nova:port uuid="780a9174-8b86-4c52-a264-92a4224ba2a3">
Apr 13 18:01:19 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 18:01:19 user nova-compute[71354]:         </nova:port>
Apr 13 18:01:19 user nova-compute[71354]:       </nova:ports>
Apr 13 18:01:19 user nova-compute[71354]:     </nova:instance>
Apr 13 18:01:19 user nova-compute[71354]:   </metadata>
Apr 13 18:01:19 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:01:19 user nova-compute[71354]:     <system>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="serial">b35e0e9b-3b18-4ef8-8299-bff7643aaccd</entry>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="uuid">b35e0e9b-3b18-4ef8-8299-bff7643aaccd</entry>
Apr 13 18:01:19 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:01:19 user nova-compute[71354]:     </system>
Apr 13 18:01:19 user nova-compute[71354]:   </sysinfo>
Apr 13 18:01:19 user nova-compute[71354]:   <os>
Apr 13 18:01:19 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:01:19 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:01:19 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:01:19 user nova-compute[71354]:   </os>
Apr 13 18:01:19 user nova-compute[71354]:   <features>
Apr 13 18:01:19 user nova-compute[71354]:     <acpi/>
Apr 13 18:01:19 user nova-compute[71354]:     <apic/>
Apr 13 18:01:19 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:01:19 user nova-compute[71354]:   </features>
Apr 13 18:01:19 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:01:19 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:01:19 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:01:19 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:01:19 user nova-compute[71354]:   </clock>
Apr 13 18:01:19 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:01:19 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:01:19 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:01:19 user nova-compute[71354]:   </cpu>
Apr 13 18:01:19 user nova-compute[71354]:   <devices>
Apr 13 18:01:19 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:01:19 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:19 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 18:01:19 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:01:19 user nova-compute[71354]:       <serial>2afce609-7ea7-4958-a9dd-326c20de27a0</serial>
Apr 13 18:01:19 user nova-compute[71354]:     </disk>
Apr 13 18:01:19 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:01:19 user nova-compute[71354]:       <mac address="fa:16:3e:7d:92:f1"/>
Apr 13 18:01:19 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:19 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:01:19 user nova-compute[71354]:       <target dev="tap780a9174-8b"/>
Apr 13 18:01:19 user nova-compute[71354]:     </interface>
Apr 13 18:01:19 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:01:19 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/b35e0e9b-3b18-4ef8-8299-bff7643aaccd/console.log" append="off"/>
Apr 13 18:01:19 user nova-compute[71354]:     </serial>
Apr 13 18:01:19 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:01:19 user nova-compute[71354]:     <video>
Apr 13 18:01:19 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:19 user nova-compute[71354]:     </video>
Apr 13 18:01:19 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:01:19 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:01:19 user nova-compute[71354]:     </rng>
Apr 13 18:01:19 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:01:19 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:01:19 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:01:19 user nova-compute[71354]:     </memballoon>
Apr 13 18:01:19 user nova-compute[71354]:   </devices>
Apr 13 18:01:19 user nova-compute[71354]: </domain>
Apr 13 18:01:19 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1216519227',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-cp8ianfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:13Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=b35e0e9b-3b18-4ef8-8299-bff7643aaccd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG os_vif [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap780a9174-8b, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap780a9174-8b, col_values=(('external_ids', {'iface-id': '780a9174-8b86-4c52-a264-92a4224ba2a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:92:f1', 'vm-uuid': 'b35e0e9b-3b18-4ef8-8299-bff7643aaccd'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:19 user nova-compute[71354]: INFO os_vif [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b')
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:7d:92:f1, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] No waiting events found dispatching network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:20 user nova-compute[71354]: WARNING nova.compute.manager [req-fdaeaf7d-6b24-4c69-959f-ca7403c123c9 req-6fb2f418-1873-458c-a0d7-02df893a90ce service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received unexpected event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 for instance with vm_state building and task_state spawning.
Apr 13 18:01:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Creating image(s)
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Ensure instance console log exists: /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start _get_guest_xml network_info=[{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'fdc95eb1-16e8-46bb-b281-5f0e25984a57', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f77e2740-4711-4a10-b099-0a8e5efdbb74', 'attached_at': '', 'detached_at': '', 'volume_id': 'b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'serial': 'b22ee9b4-9d5e-407c-aee7-991ed37fadf9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:01:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:22 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:22 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4904b-359f-4350-ad50-df972f38b4fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:01:22 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9014a-b07d-4c1e-8f8a-22f70dade5cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9] added
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3253db-5b7f-43b2-82f2-f5b0d7674e11]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1105b6-de74-4eea-a373-780f4f10cff1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUkgXOEJ {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUkgXOEJ" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474fb60-39de-4e0c-9ab2-b5b187faf9b7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUkgXOEJ'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb5e597-9f3e-4cde-9497-09cf687224fd]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215e631-da4a-4984-84e1-e35f032277d1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b340046-f763-4ed4-920d-9d7db61db252]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260]
Apr 13 18:01:22 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[41586405-a570-46a8-af42-d957878050c5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[47634d3b-5b1f-4c65-8c07-c37706a04b3a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a772d-9ad0-4224-9d22-c145ce2507aa]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408882.8848417, b35e0e9b-3b18-4ef8-8299-bff7643aaccd => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] VM Resumed (Lifecycle Event)
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Instance spawned successfully.
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] No waiting events found dispatching network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:22 user nova-compute[71354]: WARNING nova.compute.manager [req-0c19501a-8f6a-4f09-b9f6-6ea0a6048ab1 req-afdfe48d-21e5-46ec-bd9d-1bb641e8a237 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received unexpected event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 for instance with vm_state building and task_state spawning.
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408882.887943, b35e0e9b-3b18-4ef8-8299-bff7643aaccd => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] VM Started (Lifecycle Event)
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:22 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:23 user nova-compute[71354]: INFO nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:23 user nova-compute[71354]: INFO nova.compute.manager [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Took 11.01 seconds to build instance.
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOSspmDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:23 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d522c2fc-c903-4d6b-ac7a-1268c89fc0b5 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.125s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26266653865666337', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266653865666337', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.339s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:23 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:23 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07741fff-d737-49e5-a18e-264584f693ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:01:23 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69401224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-69401224',id=32,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-a0vvu9cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:12Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=f77e2740-4711-4a10-b099-0a8e5efdbb74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:01:23 user nova-compute[71354]:   <uuid>f77e2740-4711-4a10-b099-0a8e5efdbb74</uuid>
Apr 13 18:01:23 user nova-compute[71354]:   <name>instance-00000020</name>
Apr 13 18:01:23 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:01:23 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:01:23 user nova-compute[71354]:   <metadata>
Apr 13 18:01:23 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:01:23 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-69401224</nova:name>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:01:22</nova:creationTime>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:01:23 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:01:23 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:owner>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 18:01:23 user nova-compute[71354]:       </nova:owner>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:01:23 user nova-compute[71354]:       <nova:ports>
Apr 13 18:01:23 user nova-compute[71354]:         <nova:port uuid="8931403f-8458-4b81-b911-280a70e1869a">
Apr 13 18:01:23 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 18:01:23 user nova-compute[71354]:         </nova:port>
Apr 13 18:01:23 user nova-compute[71354]:       </nova:ports>
Apr 13 18:01:23 user nova-compute[71354]:     </nova:instance>
Apr 13 18:01:23 user nova-compute[71354]:   </metadata>
Apr 13 18:01:23 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:01:23 user nova-compute[71354]:     <system>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="serial">f77e2740-4711-4a10-b099-0a8e5efdbb74</entry>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="uuid">f77e2740-4711-4a10-b099-0a8e5efdbb74</entry>
Apr 13 18:01:23 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:01:23 user nova-compute[71354]:     </system>
Apr 13 18:01:23 user nova-compute[71354]:   </sysinfo>
Apr 13 18:01:23 user nova-compute[71354]:   <os>
Apr 13 18:01:23 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:01:23 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:01:23 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:01:23 user nova-compute[71354]:   </os>
Apr 13 18:01:23 user nova-compute[71354]:   <features>
Apr 13 18:01:23 user nova-compute[71354]:     <acpi/>
Apr 13 18:01:23 user nova-compute[71354]:     <apic/>
Apr 13 18:01:23 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:01:23 user nova-compute[71354]:   </features>
Apr 13 18:01:23 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:01:23 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:01:23 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:01:23 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:01:23 user nova-compute[71354]:   </clock>
Apr 13 18:01:23 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:01:23 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:01:23 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:01:23 user nova-compute[71354]:   </cpu>
Apr 13 18:01:23 user nova-compute[71354]:   <devices>
Apr 13 18:01:23 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:01:23 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:23 user nova-compute[71354]:       <source dev="/dev/sde"/>
Apr 13 18:01:23 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:01:23 user nova-compute[71354]:       <serial>b22ee9b4-9d5e-407c-aee7-991ed37fadf9</serial>
Apr 13 18:01:23 user nova-compute[71354]:     </disk>
Apr 13 18:01:23 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:01:23 user nova-compute[71354]:       <mac address="fa:16:3e:69:e3:a8"/>
Apr 13 18:01:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:23 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:01:23 user nova-compute[71354]:       <target dev="tap8931403f-84"/>
Apr 13 18:01:23 user nova-compute[71354]:     </interface>
Apr 13 18:01:23 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:01:23 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/console.log" append="off"/>
Apr 13 18:01:23 user nova-compute[71354]:     </serial>
Apr 13 18:01:23 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:01:23 user nova-compute[71354]:     <video>
Apr 13 18:01:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:23 user nova-compute[71354]:     </video>
Apr 13 18:01:23 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:01:23 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:01:23 user nova-compute[71354]:     </rng>
Apr 13 18:01:23 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:01:23 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:01:23 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:01:23 user nova-compute[71354]:     </memballoon>
Apr 13 18:01:23 user nova-compute[71354]:   </devices>
Apr 13 18:01:23 user nova-compute[71354]: </domain>
Apr 13 18:01:23 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69401224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-69401224',id=32,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-a0vvu9cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:12Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=f77e2740-4711-4a10-b099-0a8e5efdbb74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_vif [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd4e09-221c-4014-ba1d-7b5298b25ca8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d] added
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8931403f-84, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8931403f-84, col_values=(('external_ids', {'iface-id': '8931403f-8458-4b81-b911-280a70e1869a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:e3:a8', 'vm-uuid': 'f77e2740-4711-4a10-b099-0a8e5efdbb74'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:23 user nova-compute[71354]: INFO os_vif [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84')
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af1690f-976a-4b9a-a7c8-4c1d0ca6e620]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7841d3-eb90-4008-94d3-4ba8759b50c1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOSspmDg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOSspmDg" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9abb5fc-1616-4169-9ac6-e0611b0d229e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oOSspmDg'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:69:e3:a8, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b426d83-6807-403c-b52e-309a9f6d4cf4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a16727-d74e-4d22-a4bf-383b2f6e682c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc281496-95ff-4797-b6a9-b3b39f668fb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260]
Apr 13 18:01:23 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d46637-2190-4631-9193-296a6ae52598]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2bdef5-1379-4985-b7da-73cacde67cc3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:23 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:23 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c394a1c-abb9-4d80-8aa3-5cbaf018b1f2]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOSspmDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== connect_volume: return (1682ms) {'type': 'block', 'scsi_wwn': '23664373732653663', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373732653663', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:01:24 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:24 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 18:01:24 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:01:24 user nova-compute[71354]:   <serial>3b799019-1d16-431b-aba7-8111109ad67d</serial>
Apr 13 18:01:24 user nova-compute[71354]: </disk>
Apr 13 18:01:24 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:25 user nova-compute[71354]: WARNING nova.compute.manager [req-a56ed1cc-7d88-49fb-adeb-45146824a7ac req-b8a5b6e5-0640-459d-bae5-3382190d973d service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state building and task_state spawning.
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing instance network info cache due to event network-changed-a494221d-1460-48b2-9a60-b2329efbf6bc. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Acquiring lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Acquired lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Refreshing network info cache for port a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:25 user nova-compute[71354]: INFO nova.compute.manager [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Terminating instance
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No VIF found with MAC fa:16:3e:6c:2d:6f, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0ef90fae-d3c8-426a-bf88-496a3c6bc095 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.422s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updated VIF entry in instance network info cache for port a494221d-1460-48b2-9a60-b2329efbf6bc. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating instance_info_cache with network_info: [{"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dbf41d9b-59bc-439a-a108-756cb27178d7 req-7079f408-2763-4b28-8c12-7f8cbb2579e6 service nova] Releasing lock "refresh_cache-34d7146a-14c1-4dc2-9e98-d1f05bbf3712" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Instance destroyed successfully.
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.objects.instance [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'resources' on Instance uuid 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-359301831',display_name='tempest-TestStampPattern-server-359301831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-359301831',id=28,image_ref='a530c0a0-c370-4663-9391-d6744c4948f9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-12s5nilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9851b648-0b93-441b-9912-2216b528d030',image_min_disk='1',image_min_ram='0',image_owner_id='433b58054cc942efad3646ebf4ff286e',image_owner_project_name='tempest-TestStampPattern-1307048889',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1307048889-project-member',image_user_id='2b565bc35a4742808d360a395858134b',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:58:42Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=34d7146a-14c1-4dc2-9e98-d1f05bbf3712,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "a494221d-1460-48b2-9a60-b2329efbf6bc", "address": "fa:16:3e:1d:f0:45", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa494221d-14", "ovs_interfaceid": "a494221d-1460-48b2-9a60-b2329efbf6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG os_vif [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa494221d-14, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:26 user nova-compute[71354]: INFO os_vif [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=a494221d-1460-48b2-9a60-b2329efbf6bc,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa494221d-14')
Apr 13 18:01:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Deleting instance files /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712_del
Apr 13 18:01:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Deletion of /opt/stack/data/nova/instances/34d7146a-14c1-4dc2-9e98-d1f05bbf3712_del complete
Apr 13 18:01:26 user nova-compute[71354]: INFO nova.compute.manager [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 18:01:26 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:01:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:26 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Took 0.55 seconds to deallocate network for instance.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:27 user nova-compute[71354]: WARNING nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state building and task_state spawning.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-vif-unplugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] No waiting events found dispatching network-vif-unplugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:27 user nova-compute[71354]: WARNING nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received unexpected event network-vif-unplugged-a494221d-1460-48b2-9a60-b2329efbf6bc for instance with vm_state deleted and task_state None.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Acquiring lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] No waiting events found dispatching network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:27 user nova-compute[71354]: WARNING nova.compute.manager [req-657b7749-b568-4631-b405-6ec7ed37f411 req-066520e5-c1e6-4e6d-aa98-e5366b53b900 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received unexpected event network-vif-plugged-a494221d-1460-48b2-9a60-b2329efbf6bc for instance with vm_state deleted and task_state None.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-c64dd431-5ff4-4ab9-b40b-02bad0032163 req-547e70ab-7b6c-4bae-9d0c-57c70187b101 service nova] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Received event network-vif-deleted-a494221d-1460-48b2-9a60-b2329efbf6bc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Deleted allocations for instance 34d7146a-14c1-4dc2-9e98-d1f05bbf3712
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408887.4939735, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Resumed (Lifecycle Event)
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance spawned successfully.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408887.4970005, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Started (Lifecycle Event)
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-eca2c0f8-62d2-4194-bbe8-4d1057625cf8 tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "34d7146a-14c1-4dc2-9e98-d1f05bbf3712" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Took 16.84 seconds to build instance.
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a2e8cf23-0937-43ab-aaa4-4eeb5ba95331 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.948s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:27 user nova-compute[71354]: INFO nova.compute.manager [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attaching volume bfc28083-a7da-4e54-9795-3fdf61c34eca to /dev/vdc
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.utils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[98abb9d7-a7b2-4535-99af-6619984a002e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a8d13-e3b2-4597-bbd0-af980fa739e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b8acc0-dc02-4ae9-ac2d-70ebf154d8b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[10415b5c-6ca7-4f8a-b147-e99930043da2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:01:28 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0313e8a4-b2fd-47b2-8371-36c6991f67aa]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG os_brick.utils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating existing volume attachment record: 9f46fdb6-fb48-417f-92be-742545d505bd {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Unshelving
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_requests' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'numa_topology' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:28 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:01:28 user nova-compute[71354]: INFO nova.compute.claims [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Claim successful on node user
Apr 13 18:01:29 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:29 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:29 user nova-compute[71354]: INFO nova.network.neutron [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating port af96f300-946c-444d-9604-b33d7fba78f3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-changed-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing instance network info cache due to event network-changed-af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Acquiring lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:01:30 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Creating image(s)
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Acquired lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG nova.network.neutron [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Refreshing network info cache for port af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.part --force-share --output=json" returned: 0 in 0.222s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG nova.virt.images [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] 92f9c415-41e9-43d8-9bf8-c1610841b0ba was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:01:32 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.part /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updated VIF entry in instance network info cache for port af96f300-946c-444d-9604-b33d7fba78f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG nova.network.neutron [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-33e28985-1490-42b2-ade1-0f3acb71b45c req-b89d5abf-95ec-4315-951f-b42e3b116b67 service nova] Releasing lock "refresh_cache-ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.part /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.converted" returned: 0 in 0.625s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blBcadxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:33 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:33 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:33 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a9e83-09b0-418f-8087-55ffbcd66d4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:01:33 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0b294-30b6-4826-b002-48afc147a2d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca] added
Apr 13 18:01:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496d1a6-75e8-49aa-b7ad-cfad087bb7de]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.753s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace692c-f6e6-441a-b64b-719bacb5470c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blBcadxA {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blBcadxA" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d120e60-91fb-45ab-b2d2-3b46849afe53]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'blBcadxA'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a037143e-e193-4485-b4d4-253c30a57dec]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011d3f6-3f35-445b-b78f-412f495886a2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:33 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55030b3-4326-4f49-bb1e-f54ca4995326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260]
Apr 13 18:01:33 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:33 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[277db6be-8016-49e5-b992-796ac7596a2f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f6d7b-accb-41b6-a9b0-4710e6ff75e5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:34 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:34 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9,backing_fmt=raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f2bef5-a7d3-4ee2-9b5d-41910debc8ef]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blBcadxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9,backing_fmt=raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk 1073741824" returned: 0 in 0.061s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'migration_context' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Rebasing disk image.
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:34 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 -F raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23864666537343232', 'path': '/dev/sdg'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864666537343232', 'path': '/dev/sdg'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:01:35 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:35 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 18:01:35 user nova-compute[71354]:   <target dev="vdc" bus="virtio"/>
Apr 13 18:01:35 user nova-compute[71354]:   <serial>bfc28083-a7da-4e54-9795-3fdf61c34eca</serial>
Apr 13 18:01:35 user nova-compute[71354]: </disk>
Apr 13 18:01:35 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] No VIF found with MAC fa:16:3e:6c:2d:6f, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:01:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2de4e63b-6aaf-4633-9f45-e59715311572 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.850s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 -F raw /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk" returned: 0 in 2.751s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Ensure instance console log exists: /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start _get_guest_xml network_info=[{"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4b7612f325bf10fe506a0c6dc1ed1f4c',container_format='bare',created_at=2023-04-13T17:59:35Z,direct_url=<?>,disk_format='qcow2',id=92f9c415-41e9-43d8-9bf8-c1610841b0ba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-634185266-shelved',owner='c3589c01630f4f83a6925d97943c574b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T17:59:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:01:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4b7612f325bf10fe506a0c6dc1ed1f4c',container_format='bare',created_at=2023-04-13T17:59:35Z,direct_url=<?>,disk_format='qcow2',id=92f9c415-41e9-43d8-9bf8-c1610841b0ba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-634185266-shelved',owner='c3589c01630f4f83a6925d97943c574b',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T17:59:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='92f9c415-41e9-43d8-9bf8-c1610841b0ba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-91694189',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:59:38.921881',shelved_host='user',shelved_image_id='92f9c415-41e9-43d8-9bf8-c1610841b0ba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'pci_devices' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:01:37 user nova-compute[71354]:   <uuid>ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</uuid>
Apr 13 18:01:37 user nova-compute[71354]:   <name>instance-00000018</name>
Apr 13 18:01:37 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:01:37 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:01:37 user nova-compute[71354]:   <metadata>
Apr 13 18:01:37 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:01:37 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-634185266</nova:name>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:01:37</nova:creationTime>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:01:37 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:01:37 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:owner>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:user uuid="6be9926ecd1d45d89aba2e65ac3e0bfc">tempest-AttachVolumeShelveTestJSON-1896381340-project-member</nova:user>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:project uuid="c3589c01630f4f83a6925d97943c574b">tempest-AttachVolumeShelveTestJSON-1896381340</nova:project>
Apr 13 18:01:37 user nova-compute[71354]:       </nova:owner>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:root type="image" uuid="92f9c415-41e9-43d8-9bf8-c1610841b0ba"/>
Apr 13 18:01:37 user nova-compute[71354]:       <nova:ports>
Apr 13 18:01:37 user nova-compute[71354]:         <nova:port uuid="af96f300-946c-444d-9604-b33d7fba78f3">
Apr 13 18:01:37 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 18:01:37 user nova-compute[71354]:         </nova:port>
Apr 13 18:01:37 user nova-compute[71354]:       </nova:ports>
Apr 13 18:01:37 user nova-compute[71354]:     </nova:instance>
Apr 13 18:01:37 user nova-compute[71354]:   </metadata>
Apr 13 18:01:37 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:01:37 user nova-compute[71354]:     <system>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="serial">ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</entry>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="uuid">ea4760b7-c4a4-4d3f-a5db-680db0f4a32a</entry>
Apr 13 18:01:37 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:01:37 user nova-compute[71354]:     </system>
Apr 13 18:01:37 user nova-compute[71354]:   </sysinfo>
Apr 13 18:01:37 user nova-compute[71354]:   <os>
Apr 13 18:01:37 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:01:37 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:01:37 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:01:37 user nova-compute[71354]:   </os>
Apr 13 18:01:37 user nova-compute[71354]:   <features>
Apr 13 18:01:37 user nova-compute[71354]:     <acpi/>
Apr 13 18:01:37 user nova-compute[71354]:     <apic/>
Apr 13 18:01:37 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:01:37 user nova-compute[71354]:   </features>
Apr 13 18:01:37 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:01:37 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:01:37 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:01:37 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:01:37 user nova-compute[71354]:   </clock>
Apr 13 18:01:37 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:01:37 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:01:37 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:01:37 user nova-compute[71354]:   </cpu>
Apr 13 18:01:37 user nova-compute[71354]:   <devices>
Apr 13 18:01:37 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:01:37 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:01:37 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk"/>
Apr 13 18:01:37 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:01:37 user nova-compute[71354]:     </disk>
Apr 13 18:01:37 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:01:37 user nova-compute[71354]:       <mac address="fa:16:3e:fa:87:98"/>
Apr 13 18:01:37 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:37 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:01:37 user nova-compute[71354]:       <target dev="tapaf96f300-94"/>
Apr 13 18:01:37 user nova-compute[71354]:     </interface>
Apr 13 18:01:37 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:01:37 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/console.log" append="off"/>
Apr 13 18:01:37 user nova-compute[71354]:     </serial>
Apr 13 18:01:37 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:01:37 user nova-compute[71354]:     <video>
Apr 13 18:01:37 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:01:37 user nova-compute[71354]:     </video>
Apr 13 18:01:37 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:01:37 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:01:37 user nova-compute[71354]:     </rng>
Apr 13 18:01:37 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:01:37 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:01:37 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:01:37 user nova-compute[71354]:     </memballoon>
Apr 13 18:01:37 user nova-compute[71354]:   </devices>
Apr 13 18:01:37 user nova-compute[71354]: </domain>
Apr 13 18:01:37 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='92f9c415-41e9-43d8-9bf8-c1610841b0ba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-91694189',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member',shelved_at='2023-04-13T17:59:38.921881',shelved_host='user',shelved_image_id='92f9c415-41e9-43d8-9bf8-c1610841b0ba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG os_vif [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf96f300-94, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf96f300-94, col_values=(('external_ids', {'iface-id': 'af96f300-946c-444d-9604-b33d7fba78f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:87:98', 'vm-uuid': 'ea4760b7-c4a4-4d3f-a5db-680db0f4a32a'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:37 user nova-compute[71354]: INFO os_vif [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94')
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] No VIF found with MAC fa:16:3e:fa:87:98, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:01:37 user nova-compute[71354]: INFO nova.compute.manager [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Detaching volume 3b799019-1d16-431b-aba7-8111109ad67d
Apr 13 18:01:37 user nova-compute[71354]: INFO nova.virt.block_device [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attempting to driver detach volume 3b799019-1d16-431b-aba7-8111109ad67d from mountpoint /dev/vdb
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Attempting to detach device vdb from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:01:37 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:37 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 18:01:37 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:01:37 user nova-compute[71354]:   <serial>3b799019-1d16-431b-aba7-8111109ad67d</serial>
Apr 13 18:01:37 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:01:37 user nova-compute[71354]: </disk>
Apr 13 18:01:37 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:01:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdb from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the persistent domain config.
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:01:37 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:37 user nova-compute[71354]:   <source dev="/dev/sdf"/>
Apr 13 18:01:37 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:01:37 user nova-compute[71354]:   <serial>3b799019-1d16-431b-aba7-8111109ad67d</serial>
Apr 13 18:01:37 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:01:37 user nova-compute[71354]: </disk>
Apr 13 18:01:37 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:01:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408898.0087526, 3137ec3f-cb47-4ec9-8321-c6a2486633e1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:01:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdb from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the live domain config.
Apr 13 18:01:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOSspmDg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:38 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c339a36-3fea-4571-8a9f-570f2bfb717c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:01:38 user nova-compute[71354]: No targets found.
Apr 13 18:01:38 user nova-compute[71354]: iSNS:
Apr 13 18:01:38 user nova-compute[71354]: No targets found.
Apr 13 18:01:38 user nova-compute[71354]: STATIC:
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:01:38 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:38 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:38 user nova-compute[71354]: FIRMWARE:
Apr 13 18:01:38 user nova-compute[71354]: No targets found.
Apr 13 18:01:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:01:38 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:01:38 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822c6df-65af-4f22-aac1-9a523cf6e849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b406799-252a-4654-a57d-a6f33c2218bd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d (non-flash)
Apr 13 18:01:38 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da764c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b42224-94d6-41ae-9abc-549f3a629587]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307304f-3e40-4182-981e-b337dda62f22]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dded9ae5-e061-49c5-b546-8896d0ba1111]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54d0f5-2295-4010-b737-418029c83b1f]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2facb3-e7d8-4de5-a5c2-b5fe8035d6fe]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d289e7-fbfa-499d-b989-d5b33582f585]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260]
Apr 13 18:01:38 user nova-compute[71354]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b799019-1d16-431b-aba7-8111109ad67d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0eb6e9-4aad-422c-866c-42eb04c4136d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== disconnect_volume: return (328ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:01:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:39 user nova-compute[71354]: WARNING nova.compute.manager [req-beaaff64-a4f8-455f-9c46-643239aa2989 req-70b28d1f-63a1-48c5-bb44-6bc9ed813d69 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9670b7a1-582e-4c43-8b6c-1ff694f2516e tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.997s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:39 user nova-compute[71354]: INFO nova.compute.manager [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Detaching volume bfc28083-a7da-4e54-9795-3fdf61c34eca
Apr 13 18:01:39 user nova-compute[71354]: INFO nova.virt.block_device [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Attempting to driver detach volume bfc28083-a7da-4e54-9795-3fdf61c34eca from mountpoint /dev/vdc
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Attempting to detach device vdc from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:01:39 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:39 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 18:01:39 user nova-compute[71354]:   <target dev="vdc" bus="virtio"/>
Apr 13 18:01:39 user nova-compute[71354]:   <serial>bfc28083-a7da-4e54-9795-3fdf61c34eca</serial>
Apr 13 18:01:39 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 18:01:39 user nova-compute[71354]: </disk>
Apr 13 18:01:39 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:01:39 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdc from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the persistent domain config.
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:01:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:01:39 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:01:39 user nova-compute[71354]:   <source dev="/dev/sdg"/>
Apr 13 18:01:39 user nova-compute[71354]:   <target dev="vdc" bus="virtio"/>
Apr 13 18:01:39 user nova-compute[71354]:   <serial>bfc28083-a7da-4e54-9795-3fdf61c34eca</serial>
Apr 13 18:01:39 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 18:01:39 user nova-compute[71354]: </disk>
Apr 13 18:01:39 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681408900.4186828, 3137ec3f-cb47-4ec9-8321-c6a2486633e1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:01:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully detached device vdc from instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1 from the live domain config.
Apr 13 18:01:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blBcadxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:01:40 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6766e96-b353-4fd5-8708-dacfce354d02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:01:40 user nova-compute[71354]: No targets found.
Apr 13 18:01:40 user nova-compute[71354]: iSNS:
Apr 13 18:01:40 user nova-compute[71354]: No targets found.
Apr 13 18:01:40 user nova-compute[71354]: STATIC:
Apr 13 18:01:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:01:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca
Apr 13 18:01:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:01:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b
Apr 13 18:01:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:40 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:01:40 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:01:40 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:01:40 user nova-compute[71354]: FIRMWARE:
Apr 13 18:01:40 user nova-compute[71354]: No targets found.
Apr 13 18:01:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:01:40 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:01:40 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.079s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d11171-494e-4343-b8c4-57818ce43a8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea31c4b-0163-4bb2-923d-f73ca3bd5cc0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:01:40 user nova-compute[71354]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca (non-flash)
Apr 13 18:01:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d40d3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca'): ({'sdg'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Removing single pathed devices sdg {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adaf456-1683-4c88-85f2-f5d1929f46d6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6553eb-cca5-4dd5-bcf8-853c71c4859a]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Flushing IO for device /dev/sdg {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fd9b2-d57f-449c-90a0-290ebf625bd1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.092s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc299c-fb2c-4426-97cf-2642886e24c3]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529fc28-448b-44ab-bdbc-0b5906464617]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd4594-bd60-486c-ae5a-b2baf05235ab]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260]
Apr 13 18:01:40 user nova-compute[71354]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca, portal: 172.16.0.220,3260] successful.
Apr 13 18:01:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc28083-a7da-4e54-9795-3fdf61c34eca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfde76-76c2-4caa-9ad3-4d7da6ca787d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] <== disconnect_volume: return (521ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:01:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408886.2613328, 34d7146a-14c1-4dc2-9e98-d1f05bbf3712 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] VM Stopped (Lifecycle Event)
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:41 user nova-compute[71354]: WARNING nova.compute.manager [req-1fa88a3d-aaef-4951-8215-8720f66d624a req-05bb968f-5543-46d6-b789-61a3c4511695 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ee5e04a5-2bf1-4e97-adaa-3a6683d82732 None None] [instance: 34d7146a-14c1-4dc2-9e98-d1f05bbf3712] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408901.505659, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Resumed (Lifecycle Event)
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance spawned successfully.
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408901.5068994, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Started (Lifecycle Event)
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:01:41 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'flavor' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f6c2f4-20c5-4e6f-8776-05e648dc22dd tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.141s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-76e8c1d9-77a6-4ba1-b00e-93e1736efc56 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.021s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:42 user nova-compute[71354]: INFO nova.compute.manager [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Terminating instance
Apr 13 18:01:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-unplugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] No waiting events found dispatching network-vif-unplugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-unplugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Acquiring lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] No waiting events found dispatching network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:01:43 user nova-compute[71354]: WARNING nova.compute.manager [req-7d1e7109-3b0c-4879-9222-b80a3cf201fb req-5b0b72e1-534c-4f1d-bc4c-14611b3e1a18 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received unexpected event network-vif-plugged-d86c3ad7-5ef2-4356-9a80-5bcf35099658 for instance with vm_state active and task_state deleting.
Apr 13 18:01:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Instance destroyed successfully.
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lazy-loading 'resources' on Instance uuid 3137ec3f-cb47-4ec9-8321-c6a2486633e1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1049189686',display_name='tempest-AttachVolumeTestJSON-server-1049189686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1049189686',id=30,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+YgyiVk19kdaRjmu/uchZVpegteCHORgIR7ZHx/HQsZEpme4M4xwCCZxpEapxFRZcdjPYDWFEZ6h5hweGRRJKYFR156zpNQbuH12loKVtDCwW2nHgO6zKHfJTAmpolhw==',key_name='tempest-keypair-1877620197',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ee8ad9e1bc74eb9b9997f7706d3f096',ramdisk_id='',reservation_id='r-2l0f1td6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2087525588',owner_user_name='tempest-AttachVolumeTestJSON-2087525588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91769944ac8048dbb1f418d232e670d3',uuid=3137ec3f-cb47-4ec9-8321-c6a2486633e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converting VIF {"id": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "address": "fa:16:3e:6c:2d:6f", "network": {"id": "32c8d5d5-0fc7-4585-ab35-0b352781dc66", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1551383741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ee8ad9e1bc74eb9b9997f7706d3f096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86c3ad7-5e", "ovs_interfaceid": "d86c3ad7-5ef2-4356-9a80-5bcf35099658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG os_vif [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd86c3ad7-5e, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:43 user nova-compute[71354]: INFO os_vif [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:2d:6f,bridge_name='br-int',has_traffic_filtering=True,id=d86c3ad7-5ef2-4356-9a80-5bcf35099658,network=Network(32c8d5d5-0fc7-4585-ab35-0b352781dc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86c3ad7-5e')
Apr 13 18:01:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Deleting instance files /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1_del
Apr 13 18:01:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Deletion of /opt/stack/data/nova/instances/3137ec3f-cb47-4ec9-8321-c6a2486633e1_del complete
Apr 13 18:01:43 user nova-compute[71354]: INFO nova.compute.manager [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 18:01:43 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:01:43 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:01:44 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Took 0.72 seconds to deallocate network for instance.
Apr 13 18:01:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-3f72c395-f057-4380-be9c-4c719b00fa16 req-8a2102fc-6b5b-4e90-8d4f-4a0b84367833 service nova] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Received event network-vif-deleted-d86c3ad7-5ef2-4356-9a80-5bcf35099658 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:01:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:44 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Deleted allocations for instance 3137ec3f-cb47-4ec9-8321-c6a2486633e1
Apr 13 18:01:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a5d4d6d5-4c58-401d-a177-b45aff100416 tempest-AttachVolumeTestJSON-2087525588 tempest-AttachVolumeTestJSON-2087525588-project-member] Lock "3137ec3f-cb47-4ec9-8321-c6a2486633e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:51 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:01:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:54 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408903.3450842, 3137ec3f-cb47-4ec9-8321-c6a2486633e1 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:01:58 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] VM Stopped (Lifecycle Event)
Apr 13 18:01:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab53ce0b-e382-4dc1-8c36-d2e9e658e9a5 None None] [instance: 3137ec3f-cb47-4ec9-8321-c6a2486633e1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:01:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:02:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:02:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.98072052001953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 9851b648-0b93-441b-9912-2216b528d030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:02:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:02:05 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:02:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:02:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [{"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-42e6a724-a30a-49db-8e06-fd1da3e57c6f" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:02:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:02:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:02:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing instance network info cache due to event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Acquiring lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Acquired lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:12 user nova-compute[71354]: DEBUG nova.network.neutron [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:02:13 user nova-compute[71354]: DEBUG nova.network.neutron [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updated VIF entry in instance network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:02:13 user nova-compute[71354]: DEBUG nova.network.neutron [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b37f5905-c4bc-4593-bce7-73def2c2bd7f req-01466d1e-570f-4042-a3b8-3a551f6d721e service nova] Releasing lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:02:16 user nova-compute[71354]: INFO nova.compute.claims [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Claim successful on node user
Apr 13 18:02:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:02:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:02:17 user nova-compute[71354]: INFO nova.virt.block_device [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Booting with volume ccc0e336-b49f-4de4-855a-62f15a62f081 at /dev/vda
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.policy [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f796555c0e242d091502725ec595c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e743d5e6104b55b57b4754fe7e668a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedee67a-7122-4e24-8ad7-7115bf3f82ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5698c-cd1f-4f62-bd57-0d2fd234ed6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c8043-b326-4a05-be6b-206619df87e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72725e88-2c02-4bac-b7e4-b51f5be00a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:02:17 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:02:17 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08575e-08ef-4a87-9935-91ef8038ea7f]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG os_brick.utils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating existing volume attachment record: 78a96c65-7a32-4075-a178-97fff7c76923 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Successfully created port: f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Successfully updated port: f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-changed-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Refreshing instance network info cache due to event network-changed-f0082b3f-a977-4bff-9b28-dc1618882e72. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance network_info: |[{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:18 user nova-compute[71354]: DEBUG nova.network.neutron [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Refreshing network info cache for port f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:02:19 user nova-compute[71354]: DEBUG nova.network.neutron [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updated VIF entry in instance network info cache for port f0082b3f-a977-4bff-9b28-dc1618882e72. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:02:19 user nova-compute[71354]: DEBUG nova.network.neutron [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-56d54dfb-7c28-44d5-b09e-d9223ffa171c req-90e2c016-b1d2-4fbd-9411-9be52f25dbef service nova] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing instance network info cache due to event network-changed-b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Acquiring lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Acquired lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Refreshing network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:02:21 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Creating image(s)
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Ensure instance console log exists: /opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start _get_guest_xml network_info=[{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '78a96c65-7a32-4075-a178-97fff7c76923', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccc0e336-b49f-4de4-855a-62f15a62f081', 'serial': 'ccc0e336-b49f-4de4-855a-62f15a62f081'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:21 user nova-compute[71354]: INFO nova.compute.manager [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Terminating instance
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:02:21 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:02:21 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:02:21 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:02:21 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:02:21 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e054a-4c44-4922-90f1-70681ad3df33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:02:21 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab0538-c2f1-4fd4-804a-42aca3d718e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081] added
Apr 13 18:02:21 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a04e20a-bee1-4876-8805-72064babf7c3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ad3c6-8fcb-4dfa-b11d-17df84285187]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:21 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxdcejAr {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxdcejAr" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301b4a0-c928-48de-b1ff-ff817ad7f96e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxdcejAr'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32643f2e-94f2-444b-a2ad-a86c59030464]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c47ef-65d9-4d64-993c-44a8f3bd63ca]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb95efc-3e9a-4f51-8b75-2ab161da6b91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]
Apr 13 18:02:22 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.
Apr 13 18:02:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-unplugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] No waiting events found dispatching network-vif-unplugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-23b5fe7b-84ae-43f5-af4b-37ccf86e9e08 req-59fc3d71-2a68-481a-99b0-de435af61601 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-unplugged-b13328b5-41f1-4f0d-a862-d2e286c0602f for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c6873f-ecaa-477f-b43b-9a422deb5a95]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebcf26-cdfb-47f0-aa05-516e4adada76]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:02:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fe5876-6736-467f-8e0d-5d855e52d026]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updated VIF entry in instance network info cache for port b13328b5-41f1-4f0d-a862-d2e286c0602f. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [{"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea930e27-ef62-4f2e-95b9-ed0add2a5b7d req-44451b93-def2-4ded-bbaf-fb83816b0792 service nova] Releasing lock "refresh_cache-9851b648-0b93-441b-9912-2216b528d030" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] Instance destroyed successfully.
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lazy-loading 'resources' on Instance uuid 9851b648-0b93-441b-9912-2216b528d030 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-415392179',display_name='tempest-TestStampPattern-server-415392179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-415392179',id=23,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOee4kPdtfOLNy1ytdjd7yBnUKAwywli75vBkY27mNMRuhoq73L4ZPE7uc6dJ0/80Gsy1bQvIFT+Crg/RZP1memr4IUvUalto0GRwTvb8iu/YKK1o7MK60JLbPjFpTYlsA==',key_name='tempest-TestStampPattern-712492187',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:55:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='433b58054cc942efad3646ebf4ff286e',ramdisk_id='',reservation_id='r-23hzw7tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1307048889',owner_user_name='tempest-TestStampPattern-1307048889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:58:28Z,user_data=None,user_id='2b565bc35a4742808d360a395858134b',uuid=9851b648-0b93-441b-9912-2216b528d030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converting VIF {"id": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "address": "fa:16:3e:30:29:50", "network": {"id": "a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1497527706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "433b58054cc942efad3646ebf4ff286e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb13328b5-41", "ovs_interfaceid": "b13328b5-41f1-4f0d-a862-d2e286c0602f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG os_vif [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb13328b5-41, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:02:22 user nova-compute[71354]: INFO os_vif [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:50,bridge_name='br-int',has_traffic_filtering=True,id=b13328b5-41f1-4f0d-a862-d2e286c0602f,network=Network(a61f2183-1b8c-4c8d-a229-5bc42f2ef0b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb13328b5-41')
Apr 13 18:02:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Deleting instance files /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030_del
Apr 13 18:02:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Deletion of /opt/stack/data/nova/instances/9851b648-0b93-441b-9912-2216b528d030_del complete
Apr 13 18:02:22 user nova-compute[71354]: INFO nova.compute.manager [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] [instance: 9851b648-0b93-441b-9912-2216b528d030] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 18:02:22 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:02:22 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:23 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] Took 0.44 seconds to deallocate network for instance.
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-deleted-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:23 user nova-compute[71354]: INFO nova.compute.manager [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Neutron deleted interface b13328b5-41f1-4f0d-a862-d2e286c0602f; detaching it from the instance and deleting it from the info cache
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23537626161343462', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626161343462', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-6c2f6ee4-5fe9-49d5-9e32-b5478575b7f3 req-162263e5-3b31-448c-8a5e-dff4b07d9a83 service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Detach interface failed, port_id=b13328b5-41f1-4f0d-a862-d2e286c0602f, reason: Instance 9851b648-0b93-441b-9912-2216b528d030 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:02:23 user nova-compute[71354]:   <uuid>c4fb17e0-e220-4f95-ac74-70a3d90ecbec</uuid>
Apr 13 18:02:23 user nova-compute[71354]:   <name>instance-00000022</name>
Apr 13 18:02:23 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:02:23 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:02:23 user nova-compute[71354]:   <metadata>
Apr 13 18:02:23 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:02:23 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:02:23 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-567832214</nova:name>
Apr 13 18:02:23 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:02:21</nova:creationTime>
Apr 13 18:02:23 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:02:23 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:02:23 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:02:23 user nova-compute[71354]:       <nova:owner>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 18:02:23 user nova-compute[71354]:       </nova:owner>
Apr 13 18:02:23 user nova-compute[71354]:       <nova:ports>
Apr 13 18:02:23 user nova-compute[71354]:         <nova:port uuid="f0082b3f-a977-4bff-9b28-dc1618882e72">
Apr 13 18:02:23 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:02:23 user nova-compute[71354]:         </nova:port>
Apr 13 18:02:23 user nova-compute[71354]:       </nova:ports>
Apr 13 18:02:23 user nova-compute[71354]:     </nova:instance>
Apr 13 18:02:23 user nova-compute[71354]:   </metadata>
Apr 13 18:02:23 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:02:23 user nova-compute[71354]:     <system>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="serial">c4fb17e0-e220-4f95-ac74-70a3d90ecbec</entry>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="uuid">c4fb17e0-e220-4f95-ac74-70a3d90ecbec</entry>
Apr 13 18:02:23 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:02:23 user nova-compute[71354]:     </system>
Apr 13 18:02:23 user nova-compute[71354]:   </sysinfo>
Apr 13 18:02:23 user nova-compute[71354]:   <os>
Apr 13 18:02:23 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:02:23 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:02:23 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:02:23 user nova-compute[71354]:   </os>
Apr 13 18:02:23 user nova-compute[71354]:   <features>
Apr 13 18:02:23 user nova-compute[71354]:     <acpi/>
Apr 13 18:02:23 user nova-compute[71354]:     <apic/>
Apr 13 18:02:23 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:02:23 user nova-compute[71354]:   </features>
Apr 13 18:02:23 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:02:23 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:02:23 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:02:23 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:02:23 user nova-compute[71354]:   </clock>
Apr 13 18:02:23 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:02:23 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:02:23 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:02:23 user nova-compute[71354]:   </cpu>
Apr 13 18:02:23 user nova-compute[71354]:   <devices>
Apr 13 18:02:23 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:02:23 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:02:23 user nova-compute[71354]:       <source dev="/dev/sdf"/>
Apr 13 18:02:23 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:02:23 user nova-compute[71354]:       <serial>ccc0e336-b49f-4de4-855a-62f15a62f081</serial>
Apr 13 18:02:23 user nova-compute[71354]:     </disk>
Apr 13 18:02:23 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:02:23 user nova-compute[71354]:       <mac address="fa:16:3e:7d:0d:33"/>
Apr 13 18:02:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:02:23 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:02:23 user nova-compute[71354]:       <target dev="tapf0082b3f-a9"/>
Apr 13 18:02:23 user nova-compute[71354]:     </interface>
Apr 13 18:02:23 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:02:23 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/console.log" append="off"/>
Apr 13 18:02:23 user nova-compute[71354]:     </serial>
Apr 13 18:02:23 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:02:23 user nova-compute[71354]:     <video>
Apr 13 18:02:23 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:02:23 user nova-compute[71354]:     </video>
Apr 13 18:02:23 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:02:23 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:02:23 user nova-compute[71354]:     </rng>
Apr 13 18:02:23 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:02:23 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:02:23 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:02:23 user nova-compute[71354]:     </memballoon>
Apr 13 18:02:23 user nova-compute[71354]:   </devices>
Apr 13 18:02:23 user nova-compute[71354]: </domain>
Apr 13 18:02:23 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG os_vif [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0082b3f-a9, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0082b3f-a9, col_values=(('external_ids', {'iface-id': 'f0082b3f-a977-4bff-9b28-dc1618882e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:0d:33', 'vm-uuid': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:23 user nova-compute[71354]: INFO os_vif [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9')
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:7d:0d:33, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:02:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:23 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Deleted allocations for instance 9851b648-0b93-441b-9912-2216b528d030
Apr 13 18:02:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6419cc69-8cf3-4bf4-b0a7-934e2e770dbc tempest-TestStampPattern-1307048889 tempest-TestStampPattern-1307048889-project-member] Lock "9851b648-0b93-441b-9912-2216b528d030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Acquiring lock "9851b648-0b93-441b-9912-2216b528d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] Lock "9851b648-0b93-441b-9912-2216b528d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] No waiting events found dispatching network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:24 user nova-compute[71354]: WARNING nova.compute.manager [req-2769c790-15c1-4186-8fe2-cf204eefbd47 req-423fb466-f627-4727-a0bd-20975a2b541a service nova] [instance: 9851b648-0b93-441b-9912-2216b528d030] Received unexpected event network-vif-plugged-b13328b5-41f1-4f0d-a862-d2e286c0602f for instance with vm_state deleted and task_state None.
Apr 13 18:02:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:24 user nova-compute[71354]: WARNING nova.compute.manager [req-27ed4210-21a6-4704-8442-c50cb3eaf7f9 req-c411e122-2ced-4422-af7f-d0354fb2833c service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state building and task_state spawning.
Apr 13 18:02:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408946.762524, c4fb17e0-e220-4f95-ac74-70a3d90ecbec => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] VM Resumed (Lifecycle Event)
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance spawned successfully.
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408946.763985, c4fb17e0-e220-4f95-ac74-70a3d90ecbec => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] VM Started (Lifecycle Event)
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:02:26 user nova-compute[71354]: INFO nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Took 5.11 seconds to spawn the instance on the hypervisor.
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:26 user nova-compute[71354]: WARNING nova.compute.manager [req-21364ed8-bcee-4da6-8c1d-fa0f63ffe936 req-f84971c2-c12e-40a3-8ecb-1947f2e8a6a2 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state building and task_state spawning.
Apr 13 18:02:27 user nova-compute[71354]: INFO nova.compute.manager [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Took 10.53 seconds to build instance.
Apr 13 18:02:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-779b8ede-b17c-4b99-ada5-5d50e09df277 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.632s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:33 user nova-compute[71354]: INFO nova.compute.manager [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Unrescuing
Apr 13 18:02:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:02:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:02:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:34 user nova-compute[71354]: WARNING nova.compute.manager [req-0b4d571b-3154-409c-9589-6e86f73f806d req-2aa38071-3163-4156-82f1-a1a177832711 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:02:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance destroyed successfully.
Apr 13 18:02:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:36 user nova-compute[71354]: WARNING nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:02:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:36 user nova-compute[71354]: WARNING nova.compute.manager [req-f07e4e56-04dc-4fa0-b873-b05fd09afa06 req-5f03d7e8-fd73-4d06-9337-5513776910c9 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:02:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:37 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408942.652338, 9851b648-0b93-441b-9912-2216b528d030 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:02:37 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 9851b648-0b93-441b-9912-2216b528d030] VM Stopped (Lifecycle Event)
Apr 13 18:02:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-eb682aec-5c8e-4f8d-b1bd-4e53bcba4c3c None None] [instance: 9851b648-0b93-441b-9912-2216b528d030] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:02:38 user nova-compute[71354]: WARNING nova.compute.manager [req-3d474407-bb18-43ad-b7a4-28eef4bd6cc5 req-ae5c75c5-92e8-4b99-9a1f-9524fdcbe462 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for dd2b2a73-ff8a-4357-bad3-6be8fd95b374 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408958.616359, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:02:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Resumed (Lifecycle Event)
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5602cad7-9803-48b4-a0b5-d25921bc1714 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:02:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408958.6194825, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:02:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Started (Lifecycle Event)
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 561b1fe2-f0d2-4966-b449-4a139e570f06 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid b75d41c6-6cf6-4162-b49b-c3205c128ef4 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid b35e0e9b-3b18-4ef8-8299-bff7643aaccd {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:53 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:02:55 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:02:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:03:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=26.086524963378906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:03:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:01 user nova-compute[71354]: INFO nova.compute.manager [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Rescuing
Apr 13 18:03:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:03:01 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating instance_info_cache with network_info: [{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.compute.manager [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:02 user nova-compute[71354]: WARNING nova.compute.manager [req-6740b63c-a536-4b90-b15b-c5374a47345d req-4cd68c5f-15d1-441f-9070-fbbb0b605e06 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state rescuing.
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance destroyed successfully.
Apr 13 18:03:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Attempting a stable device rescue
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71354) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 18:03:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Creating image(s)
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'trusted_certs' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.part --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG nova.virt.images [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] 70661680-8bf5-47be-98c2-33fd8064aaf6 was qcow2, converting to raw {{(pid=71354) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG nova.privsep.utils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71354) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.part /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.converted {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:04 user nova-compute[71354]: WARNING nova.compute.manager [req-4fb6ac81-89e2-4ddc-bc4a-cab73bf0157d req-a050cf7d-faa2-481f-80b4-33e2782c963f service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state rescuing.
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.part /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.converted" returned: 0 in 0.490s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.converted --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c.converted --force-share --output=json" returned: 0 in 0.241s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c,backing_fmt=raw /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c,backing_fmt=raw /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue" returned: 0 in 0.064s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "61d2e6b3c15d38b8201df117c27593fe0d931e1c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'migration_context' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start _get_guest_xml network_info=[{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:69:e3:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '70661680-8bf5-47be-98c2-33fd8064aaf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'fdc95eb1-16e8-46bb-b281-5f0e25984a57', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f77e2740-4711-4a10-b099-0a8e5efdbb74', 'attached_at': '', 'detached_at': '', 'volume_id': 'b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'serial': 'b22ee9b4-9d5e-407c-aee7-991ed37fadf9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'numa_topology' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'vcpu_model' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:03:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:03:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:03:05 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd6cd4-c1e9-40ca-8638-8968afacd52e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qUkgXOEJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 18:03:05 user nova-compute[71354]: node.name = iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:03:05 user nova-compute[71354]: node.tpgt = -1
Apr 13 18:03:05 user nova-compute[71354]: node.startup = automatic
Apr 13 18:03:05 user nova-compute[71354]: node.leading_login = No
Apr 13 18:03:05 user nova-compute[71354]: iface.iscsi_ifacename = default
Apr 13 18:03:05 user nova-compute[71354]: iface.net_ifacename = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.ipaddress = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.prefix_len = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.hwaddress = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.transport_name = tcp
Apr 13 18:03:05 user nova-compute[71354]: iface.initiatorname = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.vlan_id = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.vlan_priority = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.vlan_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.iface_num = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.mtu = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.port = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.bootproto = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.subnet_mask = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.gateway = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_alt_client_id = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_dns = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_learn_iqn = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_vendor_id_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_vendor_id = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.dhcp_slp_da = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.fragmentation = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.gratuitous_arp = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.incoming_forwarding = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.tos_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.tos = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.ttl = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.delayed_ack = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.tcp_nagle = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.tcp_wsf_state = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.tcp_wsf = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.tcp_timer_scale = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.tcp_timestamp = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.redirect = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.def_task_mgmt_timeout = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.header_digest = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.data_digest = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.immediate_data = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.initial_r2t = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.data_seq_inorder = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.data_pdu_inorder = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.erl = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.max_receive_data_len = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.first_burst_len = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.max_outstanding_r2t = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.max_burst_len = 0
Apr 13 18:03:05 user nova-compute[71354]: iface.chap_auth = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.bidi_chap = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.strict_login_compliance = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.discovery_auth = <empty>
Apr 13 18:03:05 user nova-compute[71354]: iface.discovery_logout = <empty>
Apr 13 18:03:05 user nova-compute[71354]: node.discovery_address = <empty>
Apr 13 18:03:05 user nova-compute[71354]: node.discovery_port = 0
Apr 13 18:03:05 user nova-compute[71354]: node.discovery_type = static
Apr 13 18:03:05 user nova-compute[71354]: node.session.initial_cmdsn = 0
Apr 13 18:03:05 user nova-compute[71354]: node.session.initial_login_retry_max = 8
Apr 13 18:03:05 user nova-compute[71354]: node.session.xmit_thread_priority = -20
Apr 13 18:03:05 user nova-compute[71354]: node.session.cmds_max = 128
Apr 13 18:03:05 user nova-compute[71354]: node.session.queue_depth = 32
Apr 13 18:03:05 user nova-compute[71354]: node.session.nr_sessions = 1
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.authmethod = CHAP
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.username = qUkgXOEJ
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.password = ***
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.username_in = <empty>
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.password_in = <empty>
Apr 13 18:03:05 user nova-compute[71354]: node.session.auth.chap_algs = MD5
Apr 13 18:03:05 user nova-compute[71354]: node.session.timeo.replacement_timeout = 120
Apr 13 18:03:05 user nova-compute[71354]: node.session.err_timeo.abort_timeout = 15
Apr 13 18:03:05 user nova-compute[71354]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 18:03:05 user nova-compute[71354]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 18:03:05 user nova-compute[71354]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.FastAbort = Yes
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.InitialR2T = No
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.ImmediateData = Yes
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.MaxConnections = 1
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 18:03:05 user nova-compute[71354]: node.session.iscsi.ERL = 0
Apr 13 18:03:05 user nova-compute[71354]: node.session.scan = manual
Apr 13 18:03:05 user nova-compute[71354]: node.session.reopen_max = 0
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].address = 172.16.0.220
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].port = 3260
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].startup = manual
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].tcp.window_size = 524288
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].tcp.type_of_service = 0
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].timeo.logout_timeout = 15
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].timeo.login_timeout = 15
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].timeo.auth_timeout = 45
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.DataDigest = None
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.IFMarker = No
Apr 13 18:03:05 user nova-compute[71354]: node.conn[0].iscsi.OFMarker = No
Apr 13 18:03:05 user nova-compute[71354]: # END RECORD
Apr 13 18:03:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7860c019-e10d-47b6-a7f7-ff6117536c0a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906bc00-a7b6-41cb-a76c-7a7d3b4ae380]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUkgXOEJ {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUkgXOEJ" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d958c16-c64e-4035-86de-bf12cf8d5e1d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUkgXOEJ'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd5616-c06b-42d3-b30f-8c52333181b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780202c-60bf-4bc3-b29f-b519d9624769]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] HCTL ('36', '0', '0', 0) found on session 36 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e5bb6-0cff-4588-b9e5-43043e3e6afc]: (4, ('0 0 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Searching for a device in session 36 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26266653865666337', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266653865666337', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69401224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-69401224',id=32,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:01:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-a0vvu9cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:01:28Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=f77e2740-4711-4a10-b099-0a8e5efdbb74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:69:e3:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "vif_mac": "fa:16:3e:69:e3:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'pci_devices' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:03:05 user nova-compute[71354]:   <uuid>f77e2740-4711-4a10-b099-0a8e5efdbb74</uuid>
Apr 13 18:03:05 user nova-compute[71354]:   <name>instance-00000020</name>
Apr 13 18:03:05 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:03:05 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:03:05 user nova-compute[71354]:   <metadata>
Apr 13 18:03:05 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:03:05 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-69401224</nova:name>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:03:05</nova:creationTime>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:03:05 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:03:05 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:owner>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:user uuid="ec5fc9c7b7234904ba39d403764420b3">tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member</nova:user>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:project uuid="d533287b8269447aab81fa7d1312d3f1">tempest-ServerBootFromVolumeStableRescueTest-1998717843</nova:project>
Apr 13 18:03:05 user nova-compute[71354]:       </nova:owner>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:03:05 user nova-compute[71354]:       <nova:ports>
Apr 13 18:03:05 user nova-compute[71354]:         <nova:port uuid="8931403f-8458-4b81-b911-280a70e1869a">
Apr 13 18:03:05 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 18:03:05 user nova-compute[71354]:         </nova:port>
Apr 13 18:03:05 user nova-compute[71354]:       </nova:ports>
Apr 13 18:03:05 user nova-compute[71354]:     </nova:instance>
Apr 13 18:03:05 user nova-compute[71354]:   </metadata>
Apr 13 18:03:05 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:03:05 user nova-compute[71354]:     <system>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="serial">f77e2740-4711-4a10-b099-0a8e5efdbb74</entry>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="uuid">f77e2740-4711-4a10-b099-0a8e5efdbb74</entry>
Apr 13 18:03:05 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:03:05 user nova-compute[71354]:     </system>
Apr 13 18:03:05 user nova-compute[71354]:   </sysinfo>
Apr 13 18:03:05 user nova-compute[71354]:   <os>
Apr 13 18:03:05 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:03:05 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:03:05 user nova-compute[71354]:   </os>
Apr 13 18:03:05 user nova-compute[71354]:   <features>
Apr 13 18:03:05 user nova-compute[71354]:     <acpi/>
Apr 13 18:03:05 user nova-compute[71354]:     <apic/>
Apr 13 18:03:05 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:03:05 user nova-compute[71354]:   </features>
Apr 13 18:03:05 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:03:05 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:03:05 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:03:05 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:03:05 user nova-compute[71354]:   </clock>
Apr 13 18:03:05 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:03:05 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:03:05 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:03:05 user nova-compute[71354]:   </cpu>
Apr 13 18:03:05 user nova-compute[71354]:   <devices>
Apr 13 18:03:05 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:03:05 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:03:05 user nova-compute[71354]:       <source dev="/dev/sde"/>
Apr 13 18:03:05 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:03:05 user nova-compute[71354]:       <serial>b22ee9b4-9d5e-407c-aee7-991ed37fadf9</serial>
Apr 13 18:03:05 user nova-compute[71354]:     </disk>
Apr 13 18:03:05 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:03:05 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:03:05 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue"/>
Apr 13 18:03:05 user nova-compute[71354]:       <target dev="vdb" bus="virtio"/>
Apr 13 18:03:05 user nova-compute[71354]:       <boot order="1"/>
Apr 13 18:03:05 user nova-compute[71354]:     </disk>
Apr 13 18:03:05 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:03:05 user nova-compute[71354]:       <mac address="fa:16:3e:69:e3:a8"/>
Apr 13 18:03:05 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:03:05 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:03:05 user nova-compute[71354]:       <target dev="tap8931403f-84"/>
Apr 13 18:03:05 user nova-compute[71354]:     </interface>
Apr 13 18:03:05 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:03:05 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/console.log" append="off"/>
Apr 13 18:03:05 user nova-compute[71354]:     </serial>
Apr 13 18:03:05 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:03:05 user nova-compute[71354]:     <video>
Apr 13 18:03:05 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:03:05 user nova-compute[71354]:     </video>
Apr 13 18:03:05 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:03:05 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:03:05 user nova-compute[71354]:     </rng>
Apr 13 18:03:05 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:03:05 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:03:05 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:03:05 user nova-compute[71354]:     </memballoon>
Apr 13 18:03:05 user nova-compute[71354]:   </devices>
Apr 13 18:03:05 user nova-compute[71354]: </domain>
Apr 13 18:03:05 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:03:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance destroyed successfully.
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:03:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] No VIF found with MAC fa:16:3e:69:e3:a8, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:07 user nova-compute[71354]: WARNING nova.compute.manager [req-976f23de-f921-4032-a25c-9fbab2a7757c req-bd8b80a6-193c-4ecb-be67-2a1b276be4fd service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state rescuing.
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:03:07 user nova-compute[71354]: INFO nova.compute.claims [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Claim successful on node user
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:03:07 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:03:07 user nova-compute[71354]: INFO nova.virt.block_device [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Booting with volume snapshot 46d380c2-a512-4460-a1ba-c025f18ea7c1 at /dev/vda
Apr 13 18:03:07 user nova-compute[71354]: DEBUG nova.policy [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:03:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Successfully created port: 7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:09 user nova-compute[71354]: WARNING nova.compute.manager [req-f3ca46a6-608a-46f4-a2a1-61e9cf112143 req-6bb41a73-e471-41c3-937d-bdcc924e4d10 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state rescuing.
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for f77e2740-4711-4a10-b099-0a8e5efdbb74 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408989.312393, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:03:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Resumed (Lifecycle Event)
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fd8974e9-d6d0-4a59-82e7-5e5111d2214d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681408989.3137338, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:03:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Started (Lifecycle Event)
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Successfully updated port: 7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-changed-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Refreshing instance network info cache due to event network-changed-7787a783-eed7-4410-8507-d02d36e120ac. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:03:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Acquiring lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:03:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updating instance_info_cache with network_info: [{"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:03:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Instance network_info: |[{"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:03:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Acquired lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:03:10 user nova-compute[71354]: DEBUG nova.network.neutron [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Refreshing network info cache for port 7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:03:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updated VIF entry in instance network info cache for port 7787a783-eed7-4410-8507-d02d36e120ac. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:03:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updating instance_info_cache with network_info: [{"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-d66ae423-6382-4ae3-b7ad-362a24b81240 req-614552e5-5551-43a5-ad8c-3a9c12465207 service nova] Releasing lock "refresh_cache-76d8a738-9a43-4d3e-9127-bd95b030380e" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:03:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.utils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79163537-7b27-43b3-a836-44b9985f8ab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0fed6-9f35-4d66-9420-77f44dcab9a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f9be2-5603-4847-a159-4962daf00b3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729b69b-54a1-42cd-9d64-f219c58441ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:03:13 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:03:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db39237-b435-4446-b501-b4643db8c057]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG os_brick.utils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:03:13 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updating existing volume attachment record: 56dcbca7-a485-4374-bb9a-09a06b4d2dc6 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:03:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:18 user nova-compute[71354]: INFO nova.compute.manager [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Terminating instance
Apr 13 18:03:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.compute.manager [req-4d8c5899-901c-4334-89f9-1d15154ee397 req-5e4b2a9c-f0db-4d37-9ef1-de9df5cf8245 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-unplugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:03:19 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Instance destroyed successfully.
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lazy-loading 'resources' on Instance uuid ea4760b7-c4a4-4d3f-a5db-680db0f4a32a {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T17:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-634185266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-634185266',id=24,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZyKsU5d3bmL/UYx8WaLL5HbYx/LyhlGbrsQ08rU0/9ERgJOpMA/oSP5ygT2oWoSAVJJWq6FEawBSbz8eCp+eykT1Y1DqGMQv/islvnWWLiXrHaPJ09U0W9Wfw/KjAghA==',key_name='tempest-keypair-91694189',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3589c01630f4f83a6925d97943c574b',ramdisk_id='',reservation_id='r-2g0evg9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1896381340',owner_user_name='tempest-AttachVolumeShelveTestJSON-1896381340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6be9926ecd1d45d89aba2e65ac3e0bfc',uuid=ea4760b7-c4a4-4d3f-a5db-680db0f4a32a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converting VIF {"id": "af96f300-946c-444d-9604-b33d7fba78f3", "address": "fa:16:3e:fa:87:98", "network": {"id": "41c99aae-50af-4003-92ae-c7c50e5f592d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1734099206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3589c01630f4f83a6925d97943c574b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96f300-94", "ovs_interfaceid": "af96f300-946c-444d-9604-b33d7fba78f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG os_vif [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf96f300-94, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:03:19 user nova-compute[71354]: INFO os_vif [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:87:98,bridge_name='br-int',has_traffic_filtering=True,id=af96f300-946c-444d-9604-b33d7fba78f3,network=Network(41c99aae-50af-4003-92ae-c7c50e5f592d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96f300-94')
Apr 13 18:03:19 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Deleting instance files /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a_del
Apr 13 18:03:19 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Deletion of /opt/stack/data/nova/instances/ea4760b7-c4a4-4d3f-a5db-680db0f4a32a_del complete
Apr 13 18:03:19 user nova-compute[71354]: INFO nova.compute.manager [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 13 18:03:19 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:03:19 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:03:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Creating image(s)
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Ensure instance console log exists: /opt/stack/data/nova/instances/76d8a738-9a43-4d3e-9127-bd95b030380e/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Start _get_guest_xml network_info=[{"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T18:03:04Z,direct_url=<?>,disk_format='qcow2',id=d8407ca4-1a8f-4d34-98bc-d4dd18b11535,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-913834036',owner='25f789d52faa469c802d7c1281ed8c82',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T18:03:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '56dcbca7-a485-4374-bb9a-09a06b4d2dc6', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etqTmgFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76d8a738-9a43-4d3e-9127-bd95b030380e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 'serial': 'b0a990f1-b3a6-444a-b85f-f3b8f31a871a'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:03:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T18:03:04Z,direct_url=<?>,disk_format='qcow2',id=d8407ca4-1a8f-4d34-98bc-d4dd18b11535,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-913834036',owner='25f789d52faa469c802d7c1281ed8c82',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T18:03:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etqTmgFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:03:20 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:03:20 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:03:20 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6268e-9416-465c-96e0-8d7c47e7b614]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:03:20 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[928ea6a2-d075-49d8-a52e-4019b6e8b30c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a] added
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[04800586-5272-4da3-920f-36ae7cc7cd82]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7378232f-b1fd-4178-940f-9a1123f982d1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etqTmgFd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etqTmgFd" returned: 0 in 0.037s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f870b-27f4-4439-ad58-4f0b7ff4eb35]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etqTmgFd'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c97ae-671c-44c3-89c4-b0d0a240bcbb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae1697f-5769-4ff0-b0c6-a2e7e586013f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-deleted-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:20 user nova-compute[71354]: INFO nova.compute.manager [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Neutron deleted interface af96f300-946c-444d-9604-b33d7fba78f3; detaching it from the instance and deleting it from the info cache
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.network.neutron [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:03:20 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Took 1.19 seconds to deallocate network for instance.
Apr 13 18:03:20 user nova-compute[71354]: DEBUG nova.compute.manager [req-5496847d-bb0b-41ee-8361-bfdd9c3692cf req-6c20eab7-f016-4b6b-be64-6f425839dad9 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Detach interface failed, port_id=af96f300-946c-444d-9604-b33d7fba78f3, reason: Instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9920e-6b4d-4b95-9a73-377dfba26bf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260]
Apr 13 18:03:20 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260] successful.
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ffd40e-c387-45c1-b3ff-0ba6b5e361a6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[691786af-9a4d-4e08-bc3c-c7f49fb685e5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:03:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:03:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[32008ad5-8d9f-437a-bb51-dde16c4c9b15]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:03:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etqTmgFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Acquiring lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] No waiting events found dispatching network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:21 user nova-compute[71354]: WARNING nova.compute.manager [req-0c550656-0a97-415f-ad05-cbb31aee7786 req-4ff0da05-9650-4a5c-b307-0a63595281d5 service nova] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Received unexpected event network-vif-plugged-af96f300-946c-444d-9604-b33d7fba78f3 for instance with vm_state deleted and task_state None.
Apr 13 18:03:21 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Deleted allocations for instance ea4760b7-c4a4-4d3f-a5db-680db0f4a32a
Apr 13 18:03:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca6b793a-8775-4a80-9502-bb106da02089 tempest-AttachVolumeShelveTestJSON-1896381340 tempest-AttachVolumeShelveTestJSON-1896381340-project-member] Lock "ea4760b7-c4a4-4d3f-a5db-680db0f4a32a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.704s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23936363563666361', 'path': '/dev/sdg'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936363563666361', 'path': '/dev/sdg'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634796653',id=35,image_ref='d8407ca4-1a8f-4d34-98bc-d4dd18b11535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-87820iok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1858052268',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:03:08Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=76d8a738-9a43-4d3e-9127-bd95b030380e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid 76d8a738-9a43-4d3e-9127-bd95b030380e {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:03:21 user nova-compute[71354]:   <uuid>76d8a738-9a43-4d3e-9127-bd95b030380e</uuid>
Apr 13 18:03:21 user nova-compute[71354]:   <name>instance-00000023</name>
Apr 13 18:03:21 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:03:21 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:03:21 user nova-compute[71354]:   <metadata>
Apr 13 18:03:21 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:03:21 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-634796653</nova:name>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:03:20</nova:creationTime>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:03:21 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:03:21 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:owner>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 18:03:21 user nova-compute[71354]:       </nova:owner>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:root type="image" uuid="d8407ca4-1a8f-4d34-98bc-d4dd18b11535"/>
Apr 13 18:03:21 user nova-compute[71354]:       <nova:ports>
Apr 13 18:03:21 user nova-compute[71354]:         <nova:port uuid="7787a783-eed7-4410-8507-d02d36e120ac">
Apr 13 18:03:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 18:03:21 user nova-compute[71354]:         </nova:port>
Apr 13 18:03:21 user nova-compute[71354]:       </nova:ports>
Apr 13 18:03:21 user nova-compute[71354]:     </nova:instance>
Apr 13 18:03:21 user nova-compute[71354]:   </metadata>
Apr 13 18:03:21 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:03:21 user nova-compute[71354]:     <system>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="serial">76d8a738-9a43-4d3e-9127-bd95b030380e</entry>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="uuid">76d8a738-9a43-4d3e-9127-bd95b030380e</entry>
Apr 13 18:03:21 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:03:21 user nova-compute[71354]:     </system>
Apr 13 18:03:21 user nova-compute[71354]:   </sysinfo>
Apr 13 18:03:21 user nova-compute[71354]:   <os>
Apr 13 18:03:21 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:03:21 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:03:21 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:03:21 user nova-compute[71354]:   </os>
Apr 13 18:03:21 user nova-compute[71354]:   <features>
Apr 13 18:03:21 user nova-compute[71354]:     <acpi/>
Apr 13 18:03:21 user nova-compute[71354]:     <apic/>
Apr 13 18:03:21 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:03:21 user nova-compute[71354]:   </features>
Apr 13 18:03:21 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:03:21 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:03:21 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:03:21 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:03:21 user nova-compute[71354]:   </clock>
Apr 13 18:03:21 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:03:21 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:03:21 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:03:21 user nova-compute[71354]:   </cpu>
Apr 13 18:03:21 user nova-compute[71354]:   <devices>
Apr 13 18:03:21 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:03:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:03:21 user nova-compute[71354]:       <source dev="/dev/sdg"/>
Apr 13 18:03:21 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:03:21 user nova-compute[71354]:       <serial>b0a990f1-b3a6-444a-b85f-f3b8f31a871a</serial>
Apr 13 18:03:21 user nova-compute[71354]:     </disk>
Apr 13 18:03:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:03:21 user nova-compute[71354]:       <mac address="fa:16:3e:d3:a6:80"/>
Apr 13 18:03:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:03:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:03:21 user nova-compute[71354]:       <target dev="tap7787a783-ee"/>
Apr 13 18:03:21 user nova-compute[71354]:     </interface>
Apr 13 18:03:21 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:03:21 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/76d8a738-9a43-4d3e-9127-bd95b030380e/console.log" append="off"/>
Apr 13 18:03:21 user nova-compute[71354]:     </serial>
Apr 13 18:03:21 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:03:21 user nova-compute[71354]:     <video>
Apr 13 18:03:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:03:21 user nova-compute[71354]:     </video>
Apr 13 18:03:21 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:03:21 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:03:21 user nova-compute[71354]:     </rng>
Apr 13 18:03:21 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:03:21 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:03:21 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:03:21 user nova-compute[71354]:     </memballoon>
Apr 13 18:03:21 user nova-compute[71354]:   </devices>
Apr 13 18:03:21 user nova-compute[71354]: </domain>
Apr 13 18:03:21 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634796653',id=35,image_ref='d8407ca4-1a8f-4d34-98bc-d4dd18b11535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-87820iok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1858052268',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:03:08Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=76d8a738-9a43-4d3e-9127-bd95b030380e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG os_vif [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7787a783-ee, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7787a783-ee, col_values=(('external_ids', {'iface-id': '7787a783-eed7-4410-8507-d02d36e120ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:a6:80', 'vm-uuid': '76d8a738-9a43-4d3e-9127-bd95b030380e'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:03:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:21 user nova-compute[71354]: INFO os_vif [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee')
Apr 13 18:03:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:03:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:d3:a6:80, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:03:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] No waiting events found dispatching network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:23 user nova-compute[71354]: WARNING nova.compute.manager [req-e5d012c1-c417-4a54-ac0a-e1606e9e4166 req-928215ea-2213-4d3c-aeff-2a5e30ba90d2 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received unexpected event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac for instance with vm_state building and task_state spawning.
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409005.4513988, 76d8a738-9a43-4d3e-9127-bd95b030380e => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] VM Resumed (Lifecycle Event)
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Instance spawned successfully.
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409005.456176, 76d8a738-9a43-4d3e-9127-bd95b030380e => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] VM Started (Lifecycle Event)
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Took 5.21 seconds to spawn the instance on the hypervisor.
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:03:25 user nova-compute[71354]: INFO nova.compute.manager [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Took 18.44 seconds to build instance.
Apr 13 18:03:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1d87f145-8428-4c45-b264-9f3215fa1bc1 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.574s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] No waiting events found dispatching network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:03:25 user nova-compute[71354]: WARNING nova.compute.manager [req-0bf4ec73-0b20-4e07-9795-c7b1cb48b95e req-46d909a4-0b88-4cc1-85bc-56d5db16602d service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received unexpected event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac for instance with vm_state active and task_state None.
Apr 13 18:03:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:34 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681408999.3547306, ea4760b7-c4a4-4d3f-a5db-680db0f4a32a => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:03:34 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] VM Stopped (Lifecycle Event)
Apr 13 18:03:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-78668176-ef4f-41c2-9343-6e49d04a19e2 None None] [instance: ea4760b7-c4a4-4d3f-a5db-680db0f4a32a] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:03:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:55 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:03:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:03:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:04:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:00 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=26.024612426757812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 76d8a738-9a43-4d3e-9127-bd95b030380e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:04:00 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:04:01 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:04:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:04:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing instance network info cache due to event network-changed-54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Acquiring lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Acquired lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Refreshing network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:07 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updated VIF entry in instance network info cache for port 54109c72-9d87-44b7-a358-864c31b9c96d. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG nova.network.neutron [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updating instance_info_cache with network_info: [{"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ea7a989d-fe8b-4551-a4f3-d7c1a22efd0f req-e6db1435-f79d-4566-af34-1ead3467c741 service nova] Releasing lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-561b1fe2-f0d2-4966-b449-4a139e570f06" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Stashing vm_state: active {{(pid=71354) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_requests' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:04:09 user nova-compute[71354]: INFO nova.compute.claims [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Claim successful on node user
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'pci_devices' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:09 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating resource usage from migration 554896c2-1e5c-444e-b9ec-946d6ede057b
Apr 13 18:04:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.463s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:09 user nova-compute[71354]: INFO nova.compute.manager [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Migrating
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-changed-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Refreshing instance network info cache due to event network-changed-f0082b3f-a977-4bff-9b28-dc1618882e72. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:04:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG nova.network.neutron [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Refreshing network info cache for port f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Starting migrate_disk_and_power_off {{(pid=71354) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:11 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance destroyed successfully.
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0082b3f-a9, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:11 user nova-compute[71354]: INFO os_vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9')
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:04:11 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updated VIF entry in instance network info cache for port f0082b3f-a977-4bff-9b28-dc1618882e72. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.network.neutron [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6b4e5-31e4-4fbf-94f5-aa7437fb1f55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:04:11 user nova-compute[71354]: No targets found.
Apr 13 18:04:11 user nova-compute[71354]: iSNS:
Apr 13 18:04:11 user nova-compute[71354]: No targets found.
Apr 13 18:04:11 user nova-compute[71354]: STATIC:
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a
Apr 13 18:04:11 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:11 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:11 user nova-compute[71354]: FIRMWARE:
Apr 13 18:04:11 user nova-compute[71354]: No targets found.
Apr 13 18:04:11 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:04:11 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:04:11 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0550b183-9a28-4caa-8ea2-5c1d28387063 req-518a90b6-6539-40b4-b636-ae79aeeaabf1 service nova] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edc8ae-d8b1-4164-9259-01f545635e53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711907f-a0f4-4bb1-858a-e25cb7075b5d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:11 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:11 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:11 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d43570a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0744e-c4a3-43c1-a024-e90d2137db89]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e8196-180c-4c16-9c8a-caf6c93673d8]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3107f50-d898-466e-9051-2f6535b09ae9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8c9a9-2635-4505-bae9-5ae041455c99]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f502c513', '/dev/disk/by-id/scsi-1SCST_BIOf502c513-57baa44b41698699', '/dev/disk/by-id/scsi-23537626161343462') {{(pid=81468) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbcf294-0d72-4e41-b65f-5086c633b1e4]: (4, None) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[400edf1c-f2f6-4f34-8e05-5433f4366927]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c95e7-efee-4359-9c3c-f0203913df8f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]
Apr 13 18:04:11 user nova-compute[71354]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.
Apr 13 18:04:11 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c68cd-c1c1-41cd-967e-2b65059a6e2a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (350ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:11 user nova-compute[71354]: WARNING nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state active and task_state resize_migrating.
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:11 user nova-compute[71354]: WARNING nova.compute.manager [req-9d4ab8c4-857c-4a49-ab05-4f810d1970a2 req-08d2a09c-beb4-43d3-b3a5-3dd66b60549a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state active and task_state resize_migrating.
Apr 13 18:04:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Port f0082b3f-a977-4bff-9b28-dc1618882e72 binding to destination host user is already ACTIVE {{(pid=71354) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG nova.network.neutron [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.utils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f5a84-332f-4025-846f-0e4b0c9a7cdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8785daf8-0c6b-4232-ab5f-dccda3ffb7ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a87888-3848-4b06-a0af-62ba1c372cbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d06c3-a52f-49f1-a07b-7ff19706f6d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:04:14 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:04:14 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee6446-5a9c-44ae-92f9-f723342d3553]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:04:14 user nova-compute[71354]: DEBUG os_brick.utils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:04:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Starting finish_migration {{(pid=71354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance directory exists: not creating {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 18:04:20 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Creating image(s)
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Ensure instance console log exists: /opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start _get_guest_xml network_info=[{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '97573a14-ad0a-4696-9ff9-0603deb8729e', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec', 'attached_at': '2023-04-13T18:04:20.000000', 'detached_at': '', 'volume_id': 'ccc0e336-b49f-4de4-855a-62f15a62f081', 'serial': 'ccc0e336-b49f-4de4-855a-62f15a62f081'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:04:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:04:20 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:04:20 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:04:20 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b1e16-a796-4c43-aaae-c8664bed8f5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:04:20 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ec656-1be6-4d61-be7e-d2a2307172f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081] added
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561f8cc-4008-43eb-a5a6-66942829aad6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cf50cc-7d9d-4388-a036-0d75993129a7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxdcejAr {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxdcejAr" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4cdff6-3de1-4c2a-89e7-63e87cb5b5f2]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxdcejAr'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0efa7-3c9d-4d39-957d-1553a74e9a4f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70cf26d-6d76-4fa8-9de4-cb9bc6b872b2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b2e435-82d0-483b-8d94-b28706659e00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]
Apr 13 18:04:20 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7357ab-dd28-4806-a455-686f4946afe6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e3d3a-73e1-41fa-9031-ca64c49d990f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:20 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:20 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae2649-a164-4414-9ed7-76d5a6ca28f2]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:04:20 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23537626161343462', 'path': '/dev/sdf'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626161343462', 'path': '/dev/sdf'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:04:21 user nova-compute[71354]:   <uuid>c4fb17e0-e220-4f95-ac74-70a3d90ecbec</uuid>
Apr 13 18:04:21 user nova-compute[71354]:   <name>instance-00000022</name>
Apr 13 18:04:21 user nova-compute[71354]:   <memory>196608</memory>
Apr 13 18:04:21 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:04:21 user nova-compute[71354]:   <metadata>
Apr 13 18:04:21 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:04:21 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:04:21 user nova-compute[71354]:       <nova:name>tempest-ServerActionsTestJSON-server-567832214</nova:name>
Apr 13 18:04:21 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:04:20</nova:creationTime>
Apr 13 18:04:21 user nova-compute[71354]:       <nova:flavor name="m1.micro">
Apr 13 18:04:21 user nova-compute[71354]:         <nova:memory>192</nova:memory>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:04:21 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:04:21 user nova-compute[71354]:       <nova:owner>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:user uuid="8f796555c0e242d091502725ec595c0f">tempest-ServerActionsTestJSON-1530883669-project-member</nova:user>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:project uuid="71e743d5e6104b55b57b4754fe7e668a">tempest-ServerActionsTestJSON-1530883669</nova:project>
Apr 13 18:04:21 user nova-compute[71354]:       </nova:owner>
Apr 13 18:04:21 user nova-compute[71354]:       <nova:ports>
Apr 13 18:04:21 user nova-compute[71354]:         <nova:port uuid="f0082b3f-a977-4bff-9b28-dc1618882e72">
Apr 13 18:04:21 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:04:21 user nova-compute[71354]:         </nova:port>
Apr 13 18:04:21 user nova-compute[71354]:       </nova:ports>
Apr 13 18:04:21 user nova-compute[71354]:     </nova:instance>
Apr 13 18:04:21 user nova-compute[71354]:   </metadata>
Apr 13 18:04:21 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:04:21 user nova-compute[71354]:     <system>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="serial">c4fb17e0-e220-4f95-ac74-70a3d90ecbec</entry>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="uuid">c4fb17e0-e220-4f95-ac74-70a3d90ecbec</entry>
Apr 13 18:04:21 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:04:21 user nova-compute[71354]:     </system>
Apr 13 18:04:21 user nova-compute[71354]:   </sysinfo>
Apr 13 18:04:21 user nova-compute[71354]:   <os>
Apr 13 18:04:21 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:04:21 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:04:21 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:04:21 user nova-compute[71354]:   </os>
Apr 13 18:04:21 user nova-compute[71354]:   <features>
Apr 13 18:04:21 user nova-compute[71354]:     <acpi/>
Apr 13 18:04:21 user nova-compute[71354]:     <apic/>
Apr 13 18:04:21 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:04:21 user nova-compute[71354]:   </features>
Apr 13 18:04:21 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:04:21 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:04:21 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:04:21 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:04:21 user nova-compute[71354]:   </clock>
Apr 13 18:04:21 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:04:21 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:04:21 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:04:21 user nova-compute[71354]:   </cpu>
Apr 13 18:04:21 user nova-compute[71354]:   <devices>
Apr 13 18:04:21 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:04:21 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:04:21 user nova-compute[71354]:       <source dev="/dev/sdf"/>
Apr 13 18:04:21 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:04:21 user nova-compute[71354]:       <serial>ccc0e336-b49f-4de4-855a-62f15a62f081</serial>
Apr 13 18:04:21 user nova-compute[71354]:     </disk>
Apr 13 18:04:21 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:04:21 user nova-compute[71354]:       <mac address="fa:16:3e:7d:0d:33"/>
Apr 13 18:04:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:04:21 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:04:21 user nova-compute[71354]:       <target dev="tapf0082b3f-a9"/>
Apr 13 18:04:21 user nova-compute[71354]:     </interface>
Apr 13 18:04:21 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:04:21 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec/console.log" append="off"/>
Apr 13 18:04:21 user nova-compute[71354]:     </serial>
Apr 13 18:04:21 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:04:21 user nova-compute[71354]:     <video>
Apr 13 18:04:21 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:04:21 user nova-compute[71354]:     </video>
Apr 13 18:04:21 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:04:21 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:04:21 user nova-compute[71354]:     </rng>
Apr 13 18:04:21 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:04:21 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:04:21 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:04:21 user nova-compute[71354]:     </memballoon>
Apr 13 18:04:21 user nova-compute[71354]:   </devices>
Apr 13 18:04:21 user nova-compute[71354]: </domain>
Apr 13 18:04:21 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2011315058-network", "vif_mac": "fa:16:3e:7d:0d:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG os_vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0082b3f-a9, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0082b3f-a9, col_values=(('external_ids', {'iface-id': 'f0082b3f-a977-4bff-9b28-dc1618882e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:0d:33', 'vm-uuid': 'c4fb17e0-e220-4f95-ac74-70a3d90ecbec'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:21 user nova-compute[71354]: INFO os_vif [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9')
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:04:21 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] No VIF found with MAC fa:16:3e:7d:0d:33, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:04:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:23 user nova-compute[71354]: WARNING nova.compute.manager [req-1e2198c6-24da-4b00-9bbb-b88091dac61c req-cc8da2a9-c795-4b9d-97c6-1f757e2e2ec5 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state active and task_state resize_finish.
Apr 13 18:04:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for c4fb17e0-e220-4f95-ac74-70a3d90ecbec due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409065.1545107, c4fb17e0-e220-4f95-ac74-70a3d90ecbec => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] VM Resumed (Lifecycle Event)
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance running successfully.
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Failed to set time: agent not configured {{(pid=71354) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-5906dc29-9d5d-458c-91ea-30defc0405b6 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] finish_migration finished successfully. {{(pid=71354) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409065.1593778, c4fb17e0-e220-4f95-ac74-70a3d90ecbec => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] VM Started (Lifecycle Event)
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing instance network info cache due to event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 18:04:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.compute.manager [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Detaching volume c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.virt.block_device [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Attempting to driver detach volume c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b from mountpoint /dev/vdb
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Attempting to detach device vdb from instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:04:25 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:04:25 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:04:25 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:04:25 user nova-compute[71354]:   <serial>c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b</serial>
Apr 13 18:04:25 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:04:25 user nova-compute[71354]: </disk>
Apr 13 18:04:25 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:04:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully detached device vdb from instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 from the persistent domain config.
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:04:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:04:25 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:04:25 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:04:25 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:04:25 user nova-compute[71354]:   <serial>c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b</serial>
Apr 13 18:04:25 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:04:25 user nova-compute[71354]: </disk>
Apr 13 18:04:25 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:26 user nova-compute[71354]: WARNING nova.compute.manager [req-2608adec-e0c7-4335-89bd-477813d8dd92 req-7673464f-7f66-4a9c-8572-f92082dc5d84 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state resized and task_state None.
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409066.0876858, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:04:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully detached device vdb from instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 from the live domain config.
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxyFJHnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:04:26 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[329485fe-b6b5-4cc4-93e5-f5ffeb14914e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:04:26 user nova-compute[71354]: No targets found.
Apr 13 18:04:26 user nova-compute[71354]: iSNS:
Apr 13 18:04:26 user nova-compute[71354]: No targets found.
Apr 13 18:04:26 user nova-compute[71354]: STATIC:
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a
Apr 13 18:04:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:26 user nova-compute[71354]: FIRMWARE:
Apr 13 18:04:26 user nova-compute[71354]: No targets found.
Apr 13 18:04:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:04:26 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:04:26 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4810650-0cf1-4b11-8a74-b467af1a3701]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updated VIF entry in instance network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-66bb16dd-6f54-46e4-9484-494149d7d79e req-96c0ca77-b245-4374-82f2-9c06a3b16bbb service nova] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace99cc-37b1-49ec-88b5-38c3462de9e6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:26 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50b4102830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb48340-20fc-42a7-9bd4-11118ec9392b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4320b-84b7-4b19-9cf2-2a9f4b390107]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc3a71f-0975-422a-a77b-48ee67a011b3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5dcce3-aea4-4889-bd81-0c53b6239915]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec245c-5f5d-4bc1-a572-6ce5dd81c9b5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17745e-2cc4-41b8-8561-fc33105ad190]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260]
Apr 13 18:04:26 user nova-compute[71354]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b, portal: 172.16.0.220,3260] successful.
Apr 13 18:04:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a61dce-9e3b-4dd9-8c3b-ca1e3a51980b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70af3fb-d853-4bc1-9f42-52866308f7cb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] <== disconnect_volume: return (374ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:04:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG nova.compute.manager [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing instance network info cache due to event network-changed-2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Refreshing network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'flavor' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-541bf728-9ad5-4f34-896a-101e56ff4991 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.290s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updated VIF entry in instance network info cache for port 2eab9a6c-32a8-4811-8005-1b4f1a6642f1. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:04:28 user nova-compute[71354]: DEBUG nova.network.neutron [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-77258cd7-49c1-4361-8fd4-0ffc264152cb req-410f18d4-0eaf-4a2e-8be9-06dd75ee1a41 service nova] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:04:32 user nova-compute[71354]: INFO nova.compute.claims [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Claim successful on node user
Apr 13 18:04:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:04:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:04:32 user nova-compute[71354]: DEBUG nova.policy [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:04:33 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Creating image(s)
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "/opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk 1073741824" returned: 0 in 0.049s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Cannot resize image /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'migration_context' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Ensure instance console log exists: /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Successfully created port: e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Successfully updated port: e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquired lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-changed-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Refreshing instance network info cache due to event network-changed-e3e2fd87-b819-444d-afc1-f02005f3cedc. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Acquiring lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating instance_info_cache with network_info: [{"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Releasing lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Instance network_info: |[{"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Acquired lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.neutron [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Refreshing network info cache for port e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Start _get_guest_xml network_info=[{"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:04:34 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:34 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571357563',display_name='tempest-AttachVolumeNegativeTest-server-1571357563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571357563',id=36,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdOxamXsTXlK9OaACIf8bLScnUWpSxIKftQ3YDg8S6W9dnCJz+Vc57VKW/FCcFWKyA9NE0qEvzGl+mNUFxlstDlQsrnA13xf1V3Tn1dbJC7Ms2tKG6E+lwchAc6RaZqgg==',key_name='tempest-keypair-577728192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-44he5cge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=19b65bfd-ef04-44fc-b5bf-f4742705b8b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:04:34 user nova-compute[71354]:   <uuid>19b65bfd-ef04-44fc-b5bf-f4742705b8b5</uuid>
Apr 13 18:04:34 user nova-compute[71354]:   <name>instance-00000024</name>
Apr 13 18:04:34 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:04:34 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:04:34 user nova-compute[71354]:   <metadata>
Apr 13 18:04:34 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:04:34 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1571357563</nova:name>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:04:34</nova:creationTime>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:04:34 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:04:34 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:owner>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:user uuid="0ac81be2a2db40b2acbae911db8086ca">tempest-AttachVolumeNegativeTest-1374126190-project-member</nova:user>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:project uuid="c5bfb2b952aa4fd8a66d4eb5aa052e97">tempest-AttachVolumeNegativeTest-1374126190</nova:project>
Apr 13 18:04:34 user nova-compute[71354]:       </nova:owner>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:04:34 user nova-compute[71354]:       <nova:ports>
Apr 13 18:04:34 user nova-compute[71354]:         <nova:port uuid="e3e2fd87-b819-444d-afc1-f02005f3cedc">
Apr 13 18:04:34 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 18:04:34 user nova-compute[71354]:         </nova:port>
Apr 13 18:04:34 user nova-compute[71354]:       </nova:ports>
Apr 13 18:04:34 user nova-compute[71354]:     </nova:instance>
Apr 13 18:04:34 user nova-compute[71354]:   </metadata>
Apr 13 18:04:34 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:04:34 user nova-compute[71354]:     <system>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="serial">19b65bfd-ef04-44fc-b5bf-f4742705b8b5</entry>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="uuid">19b65bfd-ef04-44fc-b5bf-f4742705b8b5</entry>
Apr 13 18:04:34 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:04:34 user nova-compute[71354]:     </system>
Apr 13 18:04:34 user nova-compute[71354]:   </sysinfo>
Apr 13 18:04:34 user nova-compute[71354]:   <os>
Apr 13 18:04:34 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:04:34 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:04:34 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:04:34 user nova-compute[71354]:   </os>
Apr 13 18:04:34 user nova-compute[71354]:   <features>
Apr 13 18:04:34 user nova-compute[71354]:     <acpi/>
Apr 13 18:04:34 user nova-compute[71354]:     <apic/>
Apr 13 18:04:34 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:04:34 user nova-compute[71354]:   </features>
Apr 13 18:04:34 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:04:34 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:04:34 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:04:34 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:04:34 user nova-compute[71354]:   </clock>
Apr 13 18:04:34 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:04:34 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:04:34 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:04:34 user nova-compute[71354]:   </cpu>
Apr 13 18:04:34 user nova-compute[71354]:   <devices>
Apr 13 18:04:34 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:04:34 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:04:34 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk"/>
Apr 13 18:04:34 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:04:34 user nova-compute[71354]:     </disk>
Apr 13 18:04:34 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:04:34 user nova-compute[71354]:       <mac address="fa:16:3e:d4:c0:67"/>
Apr 13 18:04:34 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:04:34 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:04:34 user nova-compute[71354]:       <target dev="tape3e2fd87-b8"/>
Apr 13 18:04:34 user nova-compute[71354]:     </interface>
Apr 13 18:04:34 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:04:34 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/console.log" append="off"/>
Apr 13 18:04:34 user nova-compute[71354]:     </serial>
Apr 13 18:04:34 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:04:34 user nova-compute[71354]:     <video>
Apr 13 18:04:34 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:04:34 user nova-compute[71354]:     </video>
Apr 13 18:04:34 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:04:34 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:04:34 user nova-compute[71354]:     </rng>
Apr 13 18:04:34 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:04:34 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:04:34 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:04:34 user nova-compute[71354]:     </memballoon>
Apr 13 18:04:34 user nova-compute[71354]:   </devices>
Apr 13 18:04:34 user nova-compute[71354]: </domain>
Apr 13 18:04:34 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571357563',display_name='tempest-AttachVolumeNegativeTest-server-1571357563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571357563',id=36,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdOxamXsTXlK9OaACIf8bLScnUWpSxIKftQ3YDg8S6W9dnCJz+Vc57VKW/FCcFWKyA9NE0qEvzGl+mNUFxlstDlQsrnA13xf1V3Tn1dbJC7Ms2tKG6E+lwchAc6RaZqgg==',key_name='tempest-keypair-577728192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-44he5cge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=19b65bfd-ef04-44fc-b5bf-f4742705b8b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG os_vif [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3e2fd87-b8, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3e2fd87-b8, col_values=(('external_ids', {'iface-id': 'e3e2fd87-b819-444d-afc1-f02005f3cedc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c0:67', 'vm-uuid': '19b65bfd-ef04-44fc-b5bf-f4742705b8b5'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:04:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:34 user nova-compute[71354]: INFO os_vif [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8')
Apr 13 18:04:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:04:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:d4:c0:67, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:04:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updated VIF entry in instance network info cache for port e3e2fd87-b819-444d-afc1-f02005f3cedc. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:04:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating instance_info_cache with network_info: [{"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bcf6948a-59cd-48af-a7e2-c6b945104f65 req-51f2cc1b-dcdf-4d6c-912f-d19074802d4e service nova] Releasing lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] No waiting events found dispatching network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:36 user nova-compute[71354]: WARNING nova.compute.manager [req-253f0fcc-0a3e-44fd-a173-9611acfddc56 req-134da561-e170-4eba-b8b4-63b03f69a522 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received unexpected event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc for instance with vm_state building and task_state spawning.
Apr 13 18:04:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409078.660223, 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] VM Resumed (Lifecycle Event)
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Instance spawned successfully.
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] No waiting events found dispatching network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:38 user nova-compute[71354]: WARNING nova.compute.manager [req-04060800-f06d-4ea5-af8c-c4c5ba468825 req-d52c0c20-8d96-43d1-9a37-37bbee7a025f service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received unexpected event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc for instance with vm_state building and task_state spawning.
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409078.6636295, 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] VM Started (Lifecycle Event)
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Took 5.73 seconds to spawn the instance on the hypervisor.
Apr 13 18:04:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:04:38 user nova-compute[71354]: INFO nova.compute.manager [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Took 6.67 seconds to build instance.
Apr 13 18:04:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7e190d4a-e166-4162-952b-89ef54175c39 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.834s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:52 user nova-compute[71354]: INFO nova.compute.manager [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Unrescuing
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquired lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG nova.network.neutron [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating instance_info_cache with network_info: [{"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Releasing lock "refresh_cache-f77e2740-4711-4a10-b099-0a8e5efdbb74" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG nova.objects.instance [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'flavor' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:53 user nova-compute[71354]: WARNING nova.compute.manager [req-89521efa-d755-4ea5-a02b-94ca459871fd req-4952a156-7540-4a36-a8d6-2274c42f0bb2 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:04:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:53 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance destroyed successfully.
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:55 user nova-compute[71354]: WARNING nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:04:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:55 user nova-compute[71354]: WARNING nova.compute.manager [req-f4f1a871-fccb-4aa1-9b78-08879187b6dc req-35e8711d-9dca-4fd1-be87-fdff65a42d92 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state rescued and task_state unrescuing.
Apr 13 18:04:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.host [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Removed pending event for f77e2740-4711-4a10-b099-0a8e5efdbb74 due to event {{(pid=71354) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409096.8494616, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Resumed (Lifecycle Event)
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fc10eda6-07a2-4048-bdfc-39f84e995ec9 tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409096.8530774, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:04:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Started (Lifecycle Event)
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:04:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:57 user nova-compute[71354]: WARNING nova.compute.manager [req-f83f6cb7-5ecd-48e5-9df2-d57b8b98ddcb req-bc35a7a9-19d5-4b10-956f-a17c83ba5802 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state None.
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:57 user nova-compute[71354]: INFO nova.compute.manager [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Terminating instance
Apr 13 18:04:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Instance destroyed successfully.
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid 76d8a738-9a43-4d3e-9127-bd95b030380e {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-634796653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-634796653',id=35,image_ref='d8407ca4-1a8f-4d34-98bc-d4dd18b11535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-87820iok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1858052268',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:03:26Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=76d8a738-9a43-4d3e-9127-bd95b030380e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "7787a783-eed7-4410-8507-d02d36e120ac", "address": "fa:16:3e:d3:a6:80", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7787a783-ee", "ovs_interfaceid": "7787a783-eed7-4410-8507-d02d36e120ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_vif [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7787a783-ee, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:04:58 user nova-compute[71354]: INFO os_vif [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=7787a783-eed7-4410-8507-d02d36e120ac,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7787a783-ee')
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etqTmgFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:04:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bda941-ca9b-45d5-ab1a-a9778a21f726]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:04:58 user nova-compute[71354]: No targets found.
Apr 13 18:04:58 user nova-compute[71354]: iSNS:
Apr 13 18:04:58 user nova-compute[71354]: No targets found.
Apr 13 18:04:58 user nova-compute[71354]: STATIC:
Apr 13 18:04:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:04:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:04:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:04:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:04:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:58 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a
Apr 13 18:04:58 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:04:58 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:04:58 user nova-compute[71354]: FIRMWARE:
Apr 13 18:04:58 user nova-compute[71354]: No targets found.
Apr 13 18:04:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:04:58 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:04:58 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a6eb0-e1c3-4b0e-9b6f-e2c1adb5d4f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ea1e6-1179-479f-9410-5b737ec52800]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a (non-flash)
Apr 13 18:04:58 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:04:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc323e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a'): ({'sdg'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdg {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e308d-ff92-4f5e-b4ef-497ccce30f26]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da60b7-ddcf-4fca-8fc1-f4fc4804d9a2]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdg {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e949b08-39c9-4404-b976-dc79bb1f5f93]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750849e-14dc-45bb-be48-a7b34b8a84c1]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdg have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b48f5a-b52a-4abe-b124-c291da75c329]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95bf05a-7449-452e-a93c-eb7ca9d8d0b6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260]
Apr 13 18:04:58 user nova-compute[71354]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a, portal: 172.16.0.220,3260] successful.
Apr 13 18:04:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a990f1-b3a6-444a-b85f-f3b8f31a871a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf008b9-234d-4a11-847e-0b6a24c970c6]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (334ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Deleting instance files /opt/stack/data/nova/instances/76d8a738-9a43-4d3e-9127-bd95b030380e_del
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Deletion of /opt/stack/data/nova/instances/76d8a738-9a43-4d3e-9127-bd95b030380e_del complete
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.compute.manager [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 18:04:58 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Took 0.49 seconds to deallocate network for instance.
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-deleted-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:58 user nova-compute[71354]: INFO nova.compute.manager [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Neutron deleted interface 7787a783-eed7-4410-8507-d02d36e120ac; detaching it from the instance and deleting it from the info cache
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.network.neutron [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:04:58 user nova-compute[71354]: DEBUG nova.compute.manager [req-eb8f9e02-6ea5-4aa1-afcb-851efe5ccb6f req-15b886cb-0610-4724-b0ff-4c02f9c5f51e service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Detach interface failed, port_id=7787a783-eed7-4410-8507-d02d36e120ac, reason: Instance 76d8a738-9a43-4d3e-9127-bd95b030380e could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-unplugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] No waiting events found dispatching network-vif-unplugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-unplugged-7787a783-eed7-4410-8507-d02d36e120ac for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Acquiring lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] No waiting events found dispatching network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:04:59 user nova-compute[71354]: WARNING nova.compute.manager [req-fc747c9e-1970-4a2c-a84a-7b1709b04208 req-e2fb64d7-61fd-44d1-a119-8fdd8b2d1975 service nova] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Received unexpected event network-vif-plugged-7787a783-eed7-4410-8507-d02d36e120ac for instance with vm_state active and task_state deleting.
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:04:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:04:59 user nova-compute[71354]: INFO nova.compute.manager [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Took 0.95 seconds to detach 1 volumes for instance.
Apr 13 18:04:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Deleting volume: b0a990f1-b3a6-444a-b85f-f3b8f31a871a {{(pid=71354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:00 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance 76d8a738-9a43-4d3e-9127-bd95b030380e
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ff0a299a-13c5-4139-9ea1-502fd96b99f4 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "76d8a738-9a43-4d3e-9127-bd95b030380e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.679s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:05:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.98467254638672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Applying migration context for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec as it has an incoming, in-progress migration 554896c2-1e5c-444e-b9ec-946d6ede057b. Migration status is finished {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 18:05:02 user nova-compute[71354]: INFO nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating resource usage from migration 554896c2-1e5c-444e-b9ec-946d6ede057b
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Migration 554896c2-1e5c-444e-b9ec-946d6ede057b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:05:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:05:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:03 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:05:03 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:05:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:05:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:05:08 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:05:09 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [{"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:05:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-dd2b2a73-ff8a-4357-bad3-6be8fd95b374" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:05:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:05:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:13 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409098.0091994, 76d8a738-9a43-4d3e-9127-bd95b030380e => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:05:13 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] VM Stopped (Lifecycle Event)
Apr 13 18:05:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-16cb289f-a7ac-443c-8425-88d007888df4 None None] [instance: 76d8a738-9a43-4d3e-9127-bd95b030380e] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:05:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:16 user nova-compute[71354]: INFO nova.compute.manager [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Terminating instance
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-99372e7d-6ad0-4352-99f9-20bf04ba3447 req-530afbe9-5702-4452-b5e3-5ee5fe851cdf service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-unplugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:05:16 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Instance destroyed successfully.
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid dd2b2a73-ff8a-4357-bad3-6be8fd95b374 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-320463142',display_name='tempest-ServerRescueNegativeTestJSON-server-320463142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-320463142',id=29,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWBsAPFHL1kEqtOmPsrJKB5vYho0rsY7MM2yfOo6HwS5Wp/30YJfBntr9RLJhPsW7Wt1wJtGkjLqIJ5RG3sY6B0IKcGOd0soxtl42k1xZK+fo8pt+njadFWbmK0xi8LMQ==',key_name='tempest-keypair-1158147748',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-g7yn0ebl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=dd2b2a73-ff8a-4357-bad3-6be8fd95b374,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "address": "fa:16:3e:34:d0:51", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab9a6c-32", "ovs_interfaceid": "2eab9a6c-32a8-4811-8005-1b4f1a6642f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG os_vif [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eab9a6c-32, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:05:17 user nova-compute[71354]: INFO os_vif [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d0:51,bridge_name='br-int',has_traffic_filtering=True,id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab9a6c-32')
Apr 13 18:05:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Deleting instance files /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374_del
Apr 13 18:05:17 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Deletion of /opt/stack/data/nova/instances/dd2b2a73-ff8a-4357-bad3-6be8fd95b374_del complete
Apr 13 18:05:17 user nova-compute[71354]: INFO nova.compute.manager [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 13 18:05:17 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:05:17 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Took 0.72 seconds to deallocate network for instance.
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-deleted-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:17 user nova-compute[71354]: INFO nova.compute.manager [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Neutron deleted interface 2eab9a6c-32a8-4811-8005-1b4f1a6642f1; detaching it from the instance and deleting it from the info cache
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.network.neutron [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-5cecbed7-ad2b-46f6-91f7-682c23e04089 req-b8ce6fe0-89d3-475d-b014-4d5f1776c284 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Detach interface failed, port_id=2eab9a6c-32a8-4811-8005-1b4f1a6642f1, reason: Instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:18 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Deleted allocations for instance dd2b2a73-ff8a-4357-bad3-6be8fd95b374
Apr 13 18:05:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bcfe6f13-c43e-4b14-aa00-1a4d8cfa01c1 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Acquiring lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] Lock "dd2b2a73-ff8a-4357-bad3-6be8fd95b374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:18 user nova-compute[71354]: DEBUG nova.compute.manager [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] No waiting events found dispatching network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:05:18 user nova-compute[71354]: WARNING nova.compute.manager [req-12406d11-2a3a-4c99-9285-04b1721caaa5 req-f4bedddc-7f71-41cc-a08c-747a694ab470 service nova] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Received unexpected event network-vif-plugged-2eab9a6c-32a8-4811-8005-1b4f1a6642f1 for instance with vm_state deleted and task_state None.
Apr 13 18:05:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:31 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409116.881021, dd2b2a73-ff8a-4357-bad3-6be8fd95b374 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:05:31 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] VM Stopped (Lifecycle Event)
Apr 13 18:05:31 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1c98c138-7394-45ca-932c-f88998298d62 None None] [instance: dd2b2a73-ff8a-4357-bad3-6be8fd95b374] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:05:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:05:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:05:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:05:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:49 user nova-compute[71354]: INFO nova.compute.manager [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Terminating instance
Apr 13 18:05:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-unplugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] No waiting events found dispatching network-vif-unplugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7415aad-f108-42a7-b75e-23f69ca10bee req-b2f37061-c0cc-4ede-85da-730fabfc5928 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-unplugged-780a9174-8b86-4c52-a264-92a4224ba2a3 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:05:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Instance destroyed successfully.
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid b35e0e9b-3b18-4ef8-8299-bff7643aaccd {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1216519227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1216519227',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-cp8ianfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:01:23Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=b35e0e9b-3b18-4ef8-8299-bff7643aaccd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "780a9174-8b86-4c52-a264-92a4224ba2a3", "address": "fa:16:3e:7d:92:f1", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap780a9174-8b", "ovs_interfaceid": "780a9174-8b86-4c52-a264-92a4224ba2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_vif [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap780a9174-8b, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:05:50 user nova-compute[71354]: INFO os_vif [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:92:f1,bridge_name='br-int',has_traffic_filtering=True,id=780a9174-8b86-4c52-a264-92a4224ba2a3,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap780a9174-8b')
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udoYFwLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:05:50 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d93959-98dc-4cf5-94c0-fa011a47f214]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:05:50 user nova-compute[71354]: No targets found.
Apr 13 18:05:50 user nova-compute[71354]: iSNS:
Apr 13 18:05:50 user nova-compute[71354]: No targets found.
Apr 13 18:05:50 user nova-compute[71354]: STATIC:
Apr 13 18:05:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0
Apr 13 18:05:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:05:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:05:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:05:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:05:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:05:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:05:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:05:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:05:50 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:05:50 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:05:50 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:05:50 user nova-compute[71354]: FIRMWARE:
Apr 13 18:05:50 user nova-compute[71354]: No targets found.
Apr 13 18:05:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:05:50 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:05:50 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9bcea8-c862-491d-9d2d-d2e8a9fe52b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb6a80c-cc50-4066-bd1f-818d89ff0033]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:05:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d466f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb483e-6826-431c-9961-132f9ba97424]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94763f18-8513-4023-9d38-f79a4d9e1056]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace68ff-3d8f-472c-8cd4-ca8ca77dea15]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[46813c47-24dc-4b14-a459-82dcdd72859f]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f462a1-7210-4573-9510-eb9de2db56c5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[301764c6-525a-4f70-80df-ef5806d8248b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260]
Apr 13 18:05:50 user nova-compute[71354]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0, portal: 172.16.0.220,3260] successful.
Apr 13 18:05:50 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afce609-7ea7-4958-a9dd-326c20de27a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2dc8f7-6125-4b32-ab45-c2f7058d7154]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (341ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:05:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:05:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Deleting instance files /opt/stack/data/nova/instances/b35e0e9b-3b18-4ef8-8299-bff7643aaccd_del
Apr 13 18:05:50 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Deletion of /opt/stack/data/nova/instances/b35e0e9b-3b18-4ef8-8299-bff7643aaccd_del complete
Apr 13 18:05:51 user nova-compute[71354]: INFO nova.compute.manager [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 18:05:51 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:05:51 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:05:51 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:05:51 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:05:51 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Took 0.46 seconds to deallocate network for instance.
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Acquiring lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] No waiting events found dispatching network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:05:52 user nova-compute[71354]: WARNING nova.compute.manager [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received unexpected event network-vif-plugged-780a9174-8b86-4c52-a264-92a4224ba2a3 for instance with vm_state active and task_state deleting.
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-481fb589-f9ed-472c-9b64-c35dee3509ee req-b72131d2-dea1-4316-b5e6-b5eda04a9233 service nova] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Received event network-vif-deleted-780a9174-8b86-4c52-a264-92a4224ba2a3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:05:52 user nova-compute[71354]: INFO nova.compute.manager [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Took 0.82 seconds to detach 1 volumes for instance.
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.compute.manager [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Deleting volume: 2afce609-7ea7-4958-a9dd-326c20de27a0 {{(pid=71354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:52 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance b35e0e9b-3b18-4ef8-8299-bff7643aaccd
Apr 13 18:05:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-595034a1-9bb4-471f-af6d-e9aa8ddaf38a tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "b35e0e9b-3b18-4ef8-8299-bff7643aaccd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.096s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:05:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Going to confirm migration 2 {{(pid=71354) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquired lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG nova.network.neutron [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:05:58 user nova-compute[71354]: DEBUG nova.objects.instance [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'info_cache' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.network.neutron [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [{"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Releasing lock "refresh_cache-c4fb17e0-e220-4f95-ac74-70a3d90ecbec" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.objects.instance [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'migration_context' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.354s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.221s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:05:59 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Deleted allocation for migration 554896c2-1e5c-444e-b9ec-946d6ede057b
Apr 13 18:05:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:05:59 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-824d9455-0b3f-46c8-b706-806df790008a tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.229s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:02 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=7918MB free_disk=26.003108978271484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance f77e2740-4711-4a10-b099-0a8e5efdbb74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:06:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:05 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409150.5639095, b35e0e9b-3b18-4ef8-8299-bff7643aaccd => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:05 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] VM Stopped (Lifecycle Event)
Apr 13 18:06:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-be9a92e5-d073-47ee-9a38-d31a44fef455 None None] [instance: b35e0e9b-3b18-4ef8-8299-bff7643aaccd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:06:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:06:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Terminating instance
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-3a24dd76-f372-4853-95cd-456a51ceadca req-20a6ae37-bda0-4669-a34f-09630a243ee7 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-unplugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Instance destroyed successfully.
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid 42e6a724-a30a-49db-8e06-fd1da3e57c6f {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1565904434',display_name='tempest-ServerRescueNegativeTestJSON-server-1565904434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1565904434',id=17,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-epyvaovv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:52:08Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=42e6a724-a30a-49db-8e06-fd1da3e57c6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "1264cd6a-928d-4e98-808e-0911f5498d48", "address": "fa:16:3e:c7:81:72", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1264cd6a-92", "ovs_interfaceid": "1264cd6a-928d-4e98-808e-0911f5498d48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG os_vif [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1264cd6a-92, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:06:13 user nova-compute[71354]: INFO os_vif [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:81:72,bridge_name='br-int',has_traffic_filtering=True,id=1264cd6a-928d-4e98-808e-0911f5498d48,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1264cd6a-92')
Apr 13 18:06:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Deleting instance files /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f_del
Apr 13 18:06:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Deletion of /opt/stack/data/nova/instances/42e6a724-a30a-49db-8e06-fd1da3e57c6f_del complete
Apr 13 18:06:13 user nova-compute[71354]: INFO nova.compute.manager [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 18:06:13 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:06:13 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:06:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:14 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Took 0.81 seconds to deallocate network for instance.
Apr 13 18:06:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-deleted-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:14 user nova-compute[71354]: INFO nova.compute.manager [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Neutron deleted interface 1264cd6a-928d-4e98-808e-0911f5498d48; detaching it from the instance and deleting it from the info cache
Apr 13 18:06:14 user nova-compute[71354]: DEBUG nova.network.neutron [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-a63df020-5a3b-4657-a612-12e1d865c496 req-461399ea-ffda-4ae3-98ad-6ea756694bfa service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Detach interface failed, port_id=1264cd6a-928d-4e98-808e-0911f5498d48, reason: Instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:06:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:15 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Deleted allocations for instance 42e6a724-a30a-49db-8e06-fd1da3e57c6f
Apr 13 18:06:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f55a4b18-cf18-4062-bc7a-2ad2833875bc tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Acquiring lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] Lock "42e6a724-a30a-49db-8e06-fd1da3e57c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] No waiting events found dispatching network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:15 user nova-compute[71354]: WARNING nova.compute.manager [req-035cd61f-fe0a-4136-9994-3b5def2d47a8 req-2d749caa-6e84-4f62-93bb-f22c9661d741 service nova] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Received unexpected event network-vif-plugged-1264cd6a-928d-4e98-808e-0911f5498d48 for instance with vm_state deleted and task_state None.
Apr 13 18:06:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-changed-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:22 user nova-compute[71354]: DEBUG nova.compute.manager [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Refreshing instance network info cache due to event network-changed-e3e2fd87-b819-444d-afc1-f02005f3cedc. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:06:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Acquiring lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:06:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Acquired lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:06:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Refreshing network info cache for port e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:06:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updated VIF entry in instance network info cache for port e3e2fd87-b819-444d-afc1-f02005f3cedc. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:06:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating instance_info_cache with network_info: [{"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9155f491-e069-4a78-948e-7ffc31d01e1d req-e27ce9bd-8a0a-4900-82ba-434f5fe146f5 service nova] Releasing lock "refresh_cache-19b65bfd-ef04-44fc-b5bf-f4742705b8b5" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:06:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:25 user nova-compute[71354]: INFO nova.compute.manager [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Attaching volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 to /dev/vdb
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.utils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b5e6b-97a7-43f3-b129-d309b9eda1c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de0150b-ab05-4746-8c22-884031c97933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e388880-0b1e-44ef-b34b-8fb440ed3972]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ae66c-d2a4-4421-8bd6-a19a3fa4931b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:06:25 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:06:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f85cd-79e2-454d-a139-7fe4ee24b08b]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG os_brick.utils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:06:25 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating existing volume attachment record: 11f43a41-e115-45ad-971e-899746e35399 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:06:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:28 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409173.8580441, 42e6a724-a30a-49db-8e06-fd1da3e57c6f => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:28 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] VM Stopped (Lifecycle Event)
Apr 13 18:06:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0ebe3339-659f-4e7d-942c-6e87fb28b4c5 None None] [instance: 42e6a724-a30a-49db-8e06-fd1da3e57c6f] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:29 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:06:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiozUrZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:06:29 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:06:29 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:06:30 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:06:30 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1507b44-e50c-4371-8623-0f39afb8a233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:06:30 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b0f764-19ff-44e9-ab79-ef91821dc269]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65] added
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d34ae-2a07-416c-afb7-06f5bd2f9430]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60caf55f-82f8-4f21-b7f1-a9a33c20d283]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiozUrZW {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiozUrZW" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c345db-f4cb-4211-97d9-145dd9803234]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kiozUrZW'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8980c8-fd6a-4632-b878-e8df1cbf07cc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d7e0b6-7477-432e-882f-25122820146b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efbcd3-ca94-464f-9fac-0607544c15aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260]
Apr 13 18:06:30 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260] successful.
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720019b-5f99-4845-ab73-e3bb04c15b2c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aaf213-04db-479d-b743-0cf679f1cf96]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:30 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4b9c2-681b-4de9-ab92-520b6274d1a6]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:06:30 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiozUrZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23734646564386363', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734646564386363', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:06:31 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:06:31 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:06:31 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:06:31 user nova-compute[71354]:   <serial>89cc9680-5d37-4798-a49f-0ff6e2466a65</serial>
Apr 13 18:06:31 user nova-compute[71354]: </disk>
Apr 13 18:06:31 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:06:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:d4:c0:67, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:06:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-4bd7f3f0-848f-4e06-afb4-c9a8db2a5a55 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.458s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:34 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:06:34 user nova-compute[71354]: INFO nova.compute.claims [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Claim successful on node user
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:06:35 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.policy [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:06:35 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Creating image(s)
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "/opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk 1073741824" returned: 0 in 0.049s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:06:35 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Cannot resize image /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'migration_context' on Instance uuid 94db3503-3352-4326-b52a-f8af1061fafc {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Ensure instance console log exists: /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Successfully created port: aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Successfully updated port: aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquired lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-changed-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG nova.compute.manager [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Refreshing instance network info cache due to event network-changed-aee67ff9-a673-4687-901d-66e22a39d83c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:06:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Acquiring lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.neutron [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updating instance_info_cache with network_info: [{"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Releasing lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Instance network_info: |[{"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Acquired lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.neutron [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Refreshing network info cache for port aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Start _get_guest_xml network_info=[{"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:06:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1438706224',display_name='tempest-AttachVolumeNegativeTest-server-1438706224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1438706224',id=37,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqinz0f+Srx0RHqsyD7wdwBE+v8apdgAhWJzH46gkIq3HKViJJoCKH4sGZq4DoJ3iERs9Dhb6QdQ51Wr/Wxj1KP6O7XWQx5Z/MbyWgkbJNMqmk5H4sf3Mz7PmXSDDqy9g==',key_name='tempest-keypair-178076479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-nanpuasw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=94db3503-3352-4326-b52a-f8af1061fafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'pci_devices' on Instance uuid 94db3503-3352-4326-b52a-f8af1061fafc {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:06:37 user nova-compute[71354]:   <uuid>94db3503-3352-4326-b52a-f8af1061fafc</uuid>
Apr 13 18:06:37 user nova-compute[71354]:   <name>instance-00000025</name>
Apr 13 18:06:37 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:06:37 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:06:37 user nova-compute[71354]:   <metadata>
Apr 13 18:06:37 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:06:37 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1438706224</nova:name>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:06:37</nova:creationTime>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:06:37 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:06:37 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:owner>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:user uuid="0ac81be2a2db40b2acbae911db8086ca">tempest-AttachVolumeNegativeTest-1374126190-project-member</nova:user>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:project uuid="c5bfb2b952aa4fd8a66d4eb5aa052e97">tempest-AttachVolumeNegativeTest-1374126190</nova:project>
Apr 13 18:06:37 user nova-compute[71354]:       </nova:owner>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:06:37 user nova-compute[71354]:       <nova:ports>
Apr 13 18:06:37 user nova-compute[71354]:         <nova:port uuid="aee67ff9-a673-4687-901d-66e22a39d83c">
Apr 13 18:06:37 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 18:06:37 user nova-compute[71354]:         </nova:port>
Apr 13 18:06:37 user nova-compute[71354]:       </nova:ports>
Apr 13 18:06:37 user nova-compute[71354]:     </nova:instance>
Apr 13 18:06:37 user nova-compute[71354]:   </metadata>
Apr 13 18:06:37 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:06:37 user nova-compute[71354]:     <system>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="serial">94db3503-3352-4326-b52a-f8af1061fafc</entry>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="uuid">94db3503-3352-4326-b52a-f8af1061fafc</entry>
Apr 13 18:06:37 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:06:37 user nova-compute[71354]:     </system>
Apr 13 18:06:37 user nova-compute[71354]:   </sysinfo>
Apr 13 18:06:37 user nova-compute[71354]:   <os>
Apr 13 18:06:37 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:06:37 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:06:37 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:06:37 user nova-compute[71354]:   </os>
Apr 13 18:06:37 user nova-compute[71354]:   <features>
Apr 13 18:06:37 user nova-compute[71354]:     <acpi/>
Apr 13 18:06:37 user nova-compute[71354]:     <apic/>
Apr 13 18:06:37 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:06:37 user nova-compute[71354]:   </features>
Apr 13 18:06:37 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:06:37 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:06:37 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:06:37 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:06:37 user nova-compute[71354]:   </clock>
Apr 13 18:06:37 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:06:37 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:06:37 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:06:37 user nova-compute[71354]:   </cpu>
Apr 13 18:06:37 user nova-compute[71354]:   <devices>
Apr 13 18:06:37 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:06:37 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:06:37 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk"/>
Apr 13 18:06:37 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:06:37 user nova-compute[71354]:     </disk>
Apr 13 18:06:37 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:06:37 user nova-compute[71354]:       <mac address="fa:16:3e:cf:f4:e9"/>
Apr 13 18:06:37 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:06:37 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:06:37 user nova-compute[71354]:       <target dev="tapaee67ff9-a6"/>
Apr 13 18:06:37 user nova-compute[71354]:     </interface>
Apr 13 18:06:37 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:06:37 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/console.log" append="off"/>
Apr 13 18:06:37 user nova-compute[71354]:     </serial>
Apr 13 18:06:37 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:06:37 user nova-compute[71354]:     <video>
Apr 13 18:06:37 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:06:37 user nova-compute[71354]:     </video>
Apr 13 18:06:37 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:06:37 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:06:37 user nova-compute[71354]:     </rng>
Apr 13 18:06:37 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:06:37 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:06:37 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:06:37 user nova-compute[71354]:     </memballoon>
Apr 13 18:06:37 user nova-compute[71354]:   </devices>
Apr 13 18:06:37 user nova-compute[71354]: </domain>
Apr 13 18:06:37 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1438706224',display_name='tempest-AttachVolumeNegativeTest-server-1438706224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1438706224',id=37,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqinz0f+Srx0RHqsyD7wdwBE+v8apdgAhWJzH46gkIq3HKViJJoCKH4sGZq4DoJ3iERs9Dhb6QdQ51Wr/Wxj1KP6O7XWQx5Z/MbyWgkbJNMqmk5H4sf3Mz7PmXSDDqy9g==',key_name='tempest-keypair-178076479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-nanpuasw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=94db3503-3352-4326-b52a-f8af1061fafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG os_vif [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaee67ff9-a6, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaee67ff9-a6, col_values=(('external_ids', {'iface-id': 'aee67ff9-a673-4687-901d-66e22a39d83c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:f4:e9', 'vm-uuid': '94db3503-3352-4326-b52a-f8af1061fafc'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:37 user nova-compute[71354]: INFO os_vif [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6')
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:cf:f4:e9, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.neutron [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updated VIF entry in instance network info cache for port aee67ff9-a673-4687-901d-66e22a39d83c. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG nova.network.neutron [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updating instance_info_cache with network_info: [{"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-0a27853f-becc-4a29-8828-d2b6faab26ca req-d445d26d-5666-4761-ae00-9aee8e6dc7e0 service nova] Releasing lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:06:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:38 user nova-compute[71354]: DEBUG nova.compute.manager [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] No waiting events found dispatching network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:38 user nova-compute[71354]: WARNING nova.compute.manager [req-37c5d64a-87fd-4fc1-a805-54cc87518b01 req-6571fd7e-036b-4b2e-8fc2-bda12b55c592 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received unexpected event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c for instance with vm_state building and task_state spawning.
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409200.6829221, 94db3503-3352-4326-b52a-f8af1061fafc => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] VM Resumed (Lifecycle Event)
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Instance spawned successfully.
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409200.6846013, 94db3503-3352-4326-b52a-f8af1061fafc => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] VM Started (Lifecycle Event)
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 13 18:06:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:40 user nova-compute[71354]: INFO nova.compute.manager [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Took 5.99 seconds to build instance.
Apr 13 18:06:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3d04cbc3-abe4-471c-8fff-9dc58a9d1d7e tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.084s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] No waiting events found dispatching network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:41 user nova-compute[71354]: WARNING nova.compute.manager [req-ada078fb-b02b-4bc2-876e-aad0c7fe290f req-3ad8a3d2-516b-43ed-b8db-be7a111573da service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received unexpected event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c for instance with vm_state active and task_state None.
Apr 13 18:06:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:42 user nova-compute[71354]: INFO nova.compute.manager [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Terminating instance
Apr 13 18:06:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-f95d7021-320d-47c1-bd70-5a20f8ad23cb req-06b439c7-5b5b-41b3-8d5e-22ddd84b86b0 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-unplugged-8931403f-8458-4b81-b911-280a70e1869a for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Instance destroyed successfully.
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid f77e2740-4711-4a10-b099-0a8e5efdbb74 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69401224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-69401224',id=32,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:03:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-a0vvu9cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:04:57Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=f77e2740-4711-4a10-b099-0a8e5efdbb74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "8931403f-8458-4b81-b911-280a70e1869a", "address": "fa:16:3e:69:e3:a8", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8931403f-84", "ovs_interfaceid": "8931403f-8458-4b81-b911-280a70e1869a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_vif [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8931403f-84, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:43 user nova-compute[71354]: INFO os_vif [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:e3:a8,bridge_name='br-int',has_traffic_filtering=True,id=8931403f-8458-4b81-b911-280a70e1869a,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8931403f-84')
Apr 13 18:06:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUkgXOEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:06:43 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca7cdf-3045-4650-8f47-a11c50aefe81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:06:43 user nova-compute[71354]: No targets found.
Apr 13 18:06:43 user nova-compute[71354]: iSNS:
Apr 13 18:06:43 user nova-compute[71354]: No targets found.
Apr 13 18:06:43 user nova-compute[71354]: STATIC:
Apr 13 18:06:43 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:06:43 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:06:43 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:06:43 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:06:43 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:06:43 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:06:43 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:06:43 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:06:43 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:06:43 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9
Apr 13 18:06:43 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:06:43 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:06:43 user nova-compute[71354]: FIRMWARE:
Apr 13 18:06:43 user nova-compute[71354]: No targets found.
Apr 13 18:06:43 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:06:43 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:06:43 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff087d6-9cb2-4924-bea8-d0058710f113]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf2890-0037-4e3a-a8f2-d35413fbf695]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:43 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d4086dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9854fcab-455d-4e69-b61d-6ce27b91c89f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b9f99c-40ff-4236-90c5-654bf2284111]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549a743-f7dd-4af2-82b2-492ee9d7b467]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:06:43 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6825d52e-b86c-465a-ae63-759f9819e56a]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439f689-1d1d-495d-8711-51f2c4b5b5e1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163bc43-df88-44b8-a0a7-b3458efefe5b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260]
Apr 13 18:06:44 user nova-compute[71354]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9, portal: 172.16.0.220,3260] successful.
Apr 13 18:06:44 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22ee9b4-9d5e-407c-aee7-991ed37fadf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017ed9f-6b78-4d80-87de-87d332e6ae1a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== disconnect_volume: return (379ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:06:44 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Deleting instance files /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74_del
Apr 13 18:06:44 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Deletion of /opt/stack/data/nova/instances/f77e2740-4711-4a10-b099-0a8e5efdbb74_del complete
Apr 13 18:06:44 user nova-compute[71354]: INFO nova.compute.manager [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 13 18:06:44 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:06:44 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:44 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Took 0.44 seconds to deallocate network for instance.
Apr 13 18:06:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-efeafbcf-cd98-45f3-8fb2-bfdfef74cc94 req-266995aa-2d73-4bbe-bdc1-efed26f753e6 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-deleted-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Acquiring lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] No waiting events found dispatching network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:45 user nova-compute[71354]: WARNING nova.compute.manager [req-c263cd76-e839-4e54-b998-836338d3e7c5 req-bff05e94-1f9c-433e-acd1-f1c5ab487633 service nova] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Received unexpected event network-vif-plugged-8931403f-8458-4b81-b911-280a70e1869a for instance with vm_state active and task_state deleting.
Apr 13 18:06:45 user nova-compute[71354]: INFO nova.compute.manager [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:06:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:45 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Deleted allocations for instance f77e2740-4711-4a10-b099-0a8e5efdbb74
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1a145558-781c-4f2a-8ddd-2d70672a4c6d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "f77e2740-4711-4a10-b099-0a8e5efdbb74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:06:46 user nova-compute[71354]: INFO nova.compute.claims [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Claim successful on node user
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:06:46 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:06:46 user nova-compute[71354]: INFO nova.virt.block_device [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Booting with volume 329d61b0-027c-48c2-a0a1-0a93645302ce at /dev/vda
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.policy [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.utils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77381ee9-dc70-4ab7-8d48-c377f7eb7ded]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d25872-a226-467c-a7da-51f248ddcac2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70335f8-f1cd-468c-a267-767822995ab1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1179fb-3238-4d8c-a8ee-1b87678e8e6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:06:46 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:06:46 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee86bf2-d267-471f-9e6e-9a68ba5a3745]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG os_brick.utils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:06:46 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updating existing volume attachment record: 0888f101-c364-4b5a-8295-ce29f1040675 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:06:47 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Successfully created port: 85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Successfully updated port: 85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.compute.manager [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-changed-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.compute.manager [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Refreshing instance network info cache due to event network-changed-85b82f0f-9e05-4ff1-aec6-4530a2b04740. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Acquiring lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updating instance_info_cache with network_info: [{"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Instance network_info: |[{"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Acquired lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:06:48 user nova-compute[71354]: DEBUG nova.network.neutron [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Refreshing network info cache for port 85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:06:49 user nova-compute[71354]: DEBUG nova.network.neutron [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updated VIF entry in instance network info cache for port 85b82f0f-9e05-4ff1-aec6-4530a2b04740. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:06:49 user nova-compute[71354]: DEBUG nova.network.neutron [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updating instance_info_cache with network_info: [{"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:06:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-88778fbc-d96c-45e3-8897-a057d80e3ff2 req-42baed90-0da2-4330-900b-ce38365c673f service nova] Releasing lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:06:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Creating image(s)
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Ensure instance console log exists: /opt/stack/data/nova/instances/c5342d27-7121-489f-b1b7-c02d664e7fc3/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Start _get_guest_xml network_info=[{"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '0888f101-c364-4b5a-8295-ce29f1040675', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5342d27-7121-489f-b1b7-c02d664e7fc3', 'attached_at': '', 'detached_at': '', 'volume_id': '329d61b0-027c-48c2-a0a1-0a93645302ce', 'serial': '329d61b0-027c-48c2-a0a1-0a93645302ce'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:06:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:06:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:06:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:06:51 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb819aaf-b55d-4620-986b-d6eed64b5f3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:06:51 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c2a79-af9d-4b6b-819e-b9b64d93cc4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce] added
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf48c35-0db8-46f2-a8b0-b7ae9eca92fa]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae8be9c-064b-4dc8-93c8-2031ca2c4fb9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pstboqQF {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pstboqQF" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdf316-8894-457f-88ce-0ecfd1459d9d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pstboqQF'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9d265-afe1-4922-90c2-8df5dcfdf3d3]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af88f97f-db34-4149-a695-8481521f4001]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5913b62-61e4-441c-920e-a6779f6ba80b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]
Apr 13 18:06:51 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fcc9ee-83c6-4c0b-90cd-f1f42fc27dba]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de4c349-bf17-4352-9175-7b48716ee5aa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:06:51 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:06:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.146s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4fa10-2efa-4009-968e-ea1b0b20b2c2]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:06:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23135303133396535', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:06:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135303133396535', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-96331133',display_name='tempest-TestVolumeBootPattern-server-96331133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-96331133',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-g63valc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:06:47Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=c5342d27-7121-489f-b1b7-c02d664e7fc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid c5342d27-7121-489f-b1b7-c02d664e7fc3 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:06:53 user nova-compute[71354]:   <uuid>c5342d27-7121-489f-b1b7-c02d664e7fc3</uuid>
Apr 13 18:06:53 user nova-compute[71354]:   <name>instance-00000026</name>
Apr 13 18:06:53 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:06:53 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:06:53 user nova-compute[71354]:   <metadata>
Apr 13 18:06:53 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:06:53 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:06:53 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-server-96331133</nova:name>
Apr 13 18:06:53 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:06:51</nova:creationTime>
Apr 13 18:06:53 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:06:53 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:06:53 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:06:53 user nova-compute[71354]:       <nova:owner>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 18:06:53 user nova-compute[71354]:       </nova:owner>
Apr 13 18:06:53 user nova-compute[71354]:       <nova:ports>
Apr 13 18:06:53 user nova-compute[71354]:         <nova:port uuid="85b82f0f-9e05-4ff1-aec6-4530a2b04740">
Apr 13 18:06:53 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 18:06:53 user nova-compute[71354]:         </nova:port>
Apr 13 18:06:53 user nova-compute[71354]:       </nova:ports>
Apr 13 18:06:53 user nova-compute[71354]:     </nova:instance>
Apr 13 18:06:53 user nova-compute[71354]:   </metadata>
Apr 13 18:06:53 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:06:53 user nova-compute[71354]:     <system>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="serial">c5342d27-7121-489f-b1b7-c02d664e7fc3</entry>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="uuid">c5342d27-7121-489f-b1b7-c02d664e7fc3</entry>
Apr 13 18:06:53 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:06:53 user nova-compute[71354]:     </system>
Apr 13 18:06:53 user nova-compute[71354]:   </sysinfo>
Apr 13 18:06:53 user nova-compute[71354]:   <os>
Apr 13 18:06:53 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:06:53 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:06:53 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:06:53 user nova-compute[71354]:   </os>
Apr 13 18:06:53 user nova-compute[71354]:   <features>
Apr 13 18:06:53 user nova-compute[71354]:     <acpi/>
Apr 13 18:06:53 user nova-compute[71354]:     <apic/>
Apr 13 18:06:53 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:06:53 user nova-compute[71354]:   </features>
Apr 13 18:06:53 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:06:53 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:06:53 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:06:53 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:06:53 user nova-compute[71354]:   </clock>
Apr 13 18:06:53 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:06:53 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:06:53 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:06:53 user nova-compute[71354]:   </cpu>
Apr 13 18:06:53 user nova-compute[71354]:   <devices>
Apr 13 18:06:53 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:06:53 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:06:53 user nova-compute[71354]:       <source dev="/dev/sdd"/>
Apr 13 18:06:53 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:06:53 user nova-compute[71354]:       <serial>329d61b0-027c-48c2-a0a1-0a93645302ce</serial>
Apr 13 18:06:53 user nova-compute[71354]:     </disk>
Apr 13 18:06:53 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:06:53 user nova-compute[71354]:       <mac address="fa:16:3e:af:3a:63"/>
Apr 13 18:06:53 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:06:53 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:06:53 user nova-compute[71354]:       <target dev="tap85b82f0f-9e"/>
Apr 13 18:06:53 user nova-compute[71354]:     </interface>
Apr 13 18:06:53 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:06:53 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/c5342d27-7121-489f-b1b7-c02d664e7fc3/console.log" append="off"/>
Apr 13 18:06:53 user nova-compute[71354]:     </serial>
Apr 13 18:06:53 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:06:53 user nova-compute[71354]:     <video>
Apr 13 18:06:53 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:06:53 user nova-compute[71354]:     </video>
Apr 13 18:06:53 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:06:53 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:06:53 user nova-compute[71354]:     </rng>
Apr 13 18:06:53 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:06:53 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:06:53 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:06:53 user nova-compute[71354]:     </memballoon>
Apr 13 18:06:53 user nova-compute[71354]:   </devices>
Apr 13 18:06:53 user nova-compute[71354]: </domain>
Apr 13 18:06:53 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-96331133',display_name='tempest-TestVolumeBootPattern-server-96331133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-96331133',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-g63valc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:06:47Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=c5342d27-7121-489f-b1b7-c02d664e7fc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG os_vif [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85b82f0f-9e, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85b82f0f-9e, col_values=(('external_ids', {'iface-id': '85b82f0f-9e05-4ff1-aec6-4530a2b04740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:3a:63', 'vm-uuid': 'c5342d27-7121-489f-b1b7-c02d664e7fc3'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:53 user nova-compute[71354]: INFO os_vif [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e')
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:06:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:af:3a:63, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] No waiting events found dispatching network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:54 user nova-compute[71354]: WARNING nova.compute.manager [req-a79c5800-d6f0-48ce-9ec9-15be45698715 req-8bb48fcd-2d6b-4f7e-b85d-47b6f4dc89a6 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received unexpected event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance with vm_state building and task_state spawning.
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409216.4908035, c5342d27-7121-489f-b1b7-c02d664e7fc3 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] VM Resumed (Lifecycle Event)
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Instance spawned successfully.
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409216.495759, c5342d27-7121-489f-b1b7-c02d664e7fc3 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] VM Started (Lifecycle Event)
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Took 5.11 seconds to spawn the instance on the hypervisor.
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] No waiting events found dispatching network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:06:56 user nova-compute[71354]: WARNING nova.compute.manager [req-a7e2f817-87ab-4478-92cf-a3081508292e req-650dd9f5-447d-48a0-92ff-66891ae79871 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received unexpected event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance with vm_state building and task_state spawning.
Apr 13 18:06:56 user nova-compute[71354]: INFO nova.compute.manager [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Took 10.49 seconds to build instance.
Apr 13 18:06:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f24130f5-6c60-4d39-a2f8-95e1be62a33b tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.574s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:06:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:06:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:06:58 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409203.734848, f77e2740-4711-4a10-b099-0a8e5efdbb74 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:06:58 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] VM Stopped (Lifecycle Event)
Apr 13 18:06:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e723c25a-0c12-4a0b-860a-1f2efe58a046 None None] [instance: f77e2740-4711-4a10-b099-0a8e5efdbb74] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:07:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:07:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:07:03 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:07:03 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=26.010059356689453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 561b1fe2-f0d2-4966-b449-4a139e570f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 94db3503-3352-4326-b52a-f8af1061fafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:07:03 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:04 user nova-compute[71354]: INFO nova.compute.manager [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Terminating instance
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-79b51620-5e78-48df-be4e-2f7759f2937a req-fc3f3901-f3be-4ef0-a17c-60b9a6bbc460 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-unplugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:07:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Instance destroyed successfully.
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lazy-loading 'resources' on Instance uuid 474af9f8-6700-4288-8133-a8dad4cf8a88 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-787905959',display_name='tempest-ServerRescueNegativeTestJSON-server-787905959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-787905959',id=16,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:54:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ac3ae1ebe4107a05bd27710b9502b',ramdisk_id='',reservation_id='r-3jyfpoj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-766015461',owner_user_name='tempest-ServerRescueNegativeTestJSON-766015461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:50Z,user_data=None,user_id='8f1fe2e6fd894d5c87d7ccf5fae553ca',uuid=474af9f8-6700-4288-8133-a8dad4cf8a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converting VIF {"id": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "address": "fa:16:3e:23:6c:0c", "network": {"id": "d619c2d2-220f-43dd-b31d-8f5d0254fc27", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-933569849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ac3ae1ebe4107a05bd27710b9502b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc084ec2-19", "ovs_interfaceid": "bc084ec2-1969-42ed-a2d1-1e157a83f6ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG os_vif [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc084ec2-19, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:07:04 user nova-compute[71354]: INFO os_vif [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:6c:0c,bridge_name='br-int',has_traffic_filtering=True,id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac,network=Network(d619c2d2-220f-43dd-b31d-8f5d0254fc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc084ec2-19')
Apr 13 18:07:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Deleting instance files /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88_del
Apr 13 18:07:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Deletion of /opt/stack/data/nova/instances/474af9f8-6700-4288-8133-a8dad4cf8a88_del complete
Apr 13 18:07:04 user nova-compute[71354]: INFO nova.compute.manager [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 18:07:04 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:07:04 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:07:05 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Took 0.48 seconds to deallocate network for instance.
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-deleted-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:05 user nova-compute[71354]: INFO nova.compute.manager [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Neutron deleted interface bc084ec2-1969-42ed-a2d1-1e157a83f6ac; detaching it from the instance and deleting it from the info cache
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-1d3cc253-c888-4f60-93cf-bc7243a7dcd4 req-61e16829-2e88-462c-a5b3-689720b81961 service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Detach interface failed, port_id=bc084ec2-1969-42ed-a2d1-1e157a83f6ac, reason: Instance 474af9f8-6700-4288-8133-a8dad4cf8a88 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:05 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Deleted allocations for instance 474af9f8-6700-4288-8133-a8dad4cf8a88
Apr 13 18:07:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7b89318f-6c82-49f6-99a4-643971f133b7 tempest-ServerRescueNegativeTestJSON-766015461 tempest-ServerRescueNegativeTestJSON-766015461-project-member] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Acquiring lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] Lock "474af9f8-6700-4288-8133-a8dad4cf8a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] No waiting events found dispatching network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:07:06 user nova-compute[71354]: WARNING nova.compute.manager [req-299f84f2-3d6f-4098-a90c-ad389deb512d req-d8ef6d95-7ee2-4c7f-a803-c6e4bb41d1ea service nova] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Received unexpected event network-vif-plugged-bc084ec2-1969-42ed-a2d1-1e157a83f6ac for instance with vm_state deleted and task_state None.
Apr 13 18:07:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:07:10 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:07:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [{"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:07:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-db0dac50-5f78-406c-bd56-3d7cdf43d1cb" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:07:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:07:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:07:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:07:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:19 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409224.8648958, 474af9f8-6700-4288-8133-a8dad4cf8a88 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:07:19 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] VM Stopped (Lifecycle Event)
Apr 13 18:07:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f7d0fc49-9609-4ec7-929e-11d8f00a28aa None None] [instance: 474af9f8-6700-4288-8133-a8dad4cf8a88] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:07:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:07:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:33 user nova-compute[71354]: INFO nova.compute.manager [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Terminating instance
Apr 13 18:07:33 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-unplugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] No waiting events found dispatching network-vif-unplugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-54349eb1-9c06-4a70-9dc4-06f916de5e73 req-87b8f312-58bd-430b-84fc-74339e1c684b service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-unplugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:07:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Instance destroyed successfully.
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid 561b1fe2-f0d2-4966-b449-4a139e570f06 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1427952535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1427952535',id=26,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:58:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-j1auaxua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:00:08Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=561b1fe2-f0d2-4966-b449-4a139e570f06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "address": "fa:16:3e:10:f7:f4", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a4a453-df", "ovs_interfaceid": "c1a4a453-df23-4bd0-bbfe-ce9941d98bf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG os_vif [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a4a453-df, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:07:34 user nova-compute[71354]: INFO os_vif [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f7:f4,bridge_name='br-int',has_traffic_filtering=True,id=c1a4a453-df23-4bd0-bbfe-ce9941d98bf5,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a4a453-df')
Apr 13 18:07:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Deleting instance files /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06_del
Apr 13 18:07:34 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Deletion of /opt/stack/data/nova/instances/561b1fe2-f0d2-4966-b449-4a139e570f06_del complete
Apr 13 18:07:34 user nova-compute[71354]: INFO nova.compute.manager [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 18:07:34 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:07:34 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:07:35 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Took 0.48 seconds to deallocate network for instance.
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:35 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Deleted allocations for instance 561b1fe2-f0d2-4966-b449-4a139e570f06
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9d84ca54-3254-43bc-b557-6f2ec426d10f tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Acquiring lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] Lock "561b1fe2-f0d2-4966-b449-4a139e570f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] No waiting events found dispatching network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:07:35 user nova-compute[71354]: WARNING nova.compute.manager [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received unexpected event network-vif-plugged-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 for instance with vm_state deleted and task_state None.
Apr 13 18:07:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-9f5b662d-38cf-4a0f-999f-18f556f3fad8 req-c0154885-ba0d-40f8-bf85-d83e677336fd service nova] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Received event network-vif-deleted-c1a4a453-df23-4bd0-bbfe-ce9941d98bf5 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:07:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:49 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409254.2026906, 561b1fe2-f0d2-4966-b449-4a139e570f06 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:07:49 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] VM Stopped (Lifecycle Event)
Apr 13 18:07:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5ecede42-7259-42a3-be0e-acc730fc9097 None None] [instance: 561b1fe2-f0d2-4966-b449-4a139e570f06] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:07:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:07:49 user nova-compute[71354]: INFO nova.compute.manager [None req-34bec0a4-1799-46fe-a46d-448dd18dd9c8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Get console output
Apr 13 18:07:49 user nova-compute[71354]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 18:07:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:07:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:07:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:07:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:08:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:04 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:08:04 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8157MB free_disk=26.11996078491211GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 1774abdc-69cc-4755-b62a-c74bc1997944 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 94db3503-3352-4326-b52a-f8af1061fafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c5342d27-7121-489f-b1b7-c02d664e7fc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:08:04 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:08:05 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:05 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:08:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:08:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:08:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:08:10 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:08:11 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [{"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-1774abdc-69cc-4755-b62a-c74bc1997944" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:08:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:08:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:08:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:24 user nova-compute[71354]: INFO nova.compute.manager [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Terminating instance
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0d48fd2-4833-452e-8708-d3b707a8366e req-1829ec51-5ec9-4b72-9f74-a1196788e187 service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-unplugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:08:24 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Instance destroyed successfully.
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.objects.instance [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid 1774abdc-69cc-4755-b62a-c74bc1997944 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-711902791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-711902791',id=20,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-msvxrede',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:56:26Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=1774abdc-69cc-4755-b62a-c74bc1997944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "address": "fa:16:3e:29:99:e5", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdd1b17-9f", "ovs_interfaceid": "9fdd1b17-9f90-475f-b0a0-17ddea2c8c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG os_vif [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fdd1b17-9f, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:08:24 user nova-compute[71354]: INFO os_vif [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:99:e5,bridge_name='br-int',has_traffic_filtering=True,id=9fdd1b17-9f90-475f-b0a0-17ddea2c8c96,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdd1b17-9f')
Apr 13 18:08:24 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIzcOmiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:08:24 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:08:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089a4a7-04d0-48a9-b15c-1fae1212f31a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:24 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:08:24 user nova-compute[71354]: No targets found.
Apr 13 18:08:24 user nova-compute[71354]: iSNS:
Apr 13 18:08:24 user nova-compute[71354]: No targets found.
Apr 13 18:08:24 user nova-compute[71354]: STATIC:
Apr 13 18:08:24 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:08:24 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:24 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:24 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:08:24 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:24 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:24 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:08:24 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:24 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:24 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7
Apr 13 18:08:24 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:24 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:24 user nova-compute[71354]: FIRMWARE:
Apr 13 18:08:24 user nova-compute[71354]: No targets found.
Apr 13 18:08:24 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:08:25 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:08:25 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f71cd2-9914-405b-9dbb-6559fe79874a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d0df3-efea-4abb-b795-4af50a5f6a0d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:08:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:25 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:08:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da764280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20babc85-b659-4e33-a8b2-b7302d43d452]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1bd135-5f87-4a7a-9146-5fa4d7265bd7]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d43f7a-39ec-471e-a123-f00cfddb7c1f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ddd62-7e60-4e38-9e4a-486f62914b12]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb03dee-3cb2-41aa-b14b-d29e77be1fef]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d269cd2-9194-4217-a28d-9a98cbe9b062]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260]
Apr 13 18:08:25 user nova-compute[71354]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7, portal: 172.16.0.220,3260] successful.
Apr 13 18:08:25 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4ffc42-3eb3-4c09-8a63-f0f9919af7a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4baaf1-9bda-4d6c-8a6e-ae8524f49e52]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] <== disconnect_volume: return (335ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:08:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Deleting instance files /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944_del
Apr 13 18:08:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Deletion of /opt/stack/data/nova/instances/1774abdc-69cc-4755-b62a-c74bc1997944_del complete
Apr 13 18:08:25 user nova-compute[71354]: INFO nova.compute.manager [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 13 18:08:25 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:08:25 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-changed-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Refreshing instance network info cache due to event network-changed-aee67ff9-a673-4687-901d-66e22a39d83c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Acquiring lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Acquired lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Refreshing network info cache for port aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Acquiring lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] Lock "1774abdc-69cc-4755-b62a-c74bc1997944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] No waiting events found dispatching network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:26 user nova-compute[71354]: WARNING nova.compute.manager [req-e071e6e1-e650-48d4-b2f0-8076534bfda4 req-044ac5b0-6602-425c-83d7-2f490ea9cabc service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received unexpected event network-vif-plugged-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 for instance with vm_state active and task_state deleting.
Apr 13 18:08:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:26 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Took 1.39 seconds to deallocate network for instance.
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:27 user nova-compute[71354]: INFO nova.compute.manager [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Terminating instance
Apr 13 18:08:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updated VIF entry in instance network info cache for port aee67ff9-a673-4687-901d-66e22a39d83c. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG nova.network.neutron [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updating instance_info_cache with network_info: [{"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4071983d-7dbf-44b7-80c3-e15fa62022c4 req-5fbf921d-ed7c-4549-abf1-b047f218b75f service nova] Releasing lock "refresh_cache-94db3503-3352-4326-b52a-f8af1061fafc" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:27 user nova-compute[71354]: INFO nova.compute.manager [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Took 1.04 seconds to detach 1 volumes for instance.
Apr 13 18:08:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:27 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Instance destroyed successfully.
Apr 13 18:08:27 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'resources' on Instance uuid 94db3503-3352-4326-b52a-f8af1061fafc {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1438706224',display_name='tempest-AttachVolumeNegativeTest-server-1438706224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1438706224',id=37,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqinz0f+Srx0RHqsyD7wdwBE+v8apdgAhWJzH46gkIq3HKViJJoCKH4sGZq4DoJ3iERs9Dhb6QdQ51Wr/Wxj1KP6O7XWQx5Z/MbyWgkbJNMqmk5H4sf3Mz7PmXSDDqy9g==',key_name='tempest-keypair-178076479',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-nanpuasw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=94db3503-3352-4326-b52a-f8af1061fafc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "aee67ff9-a673-4687-901d-66e22a39d83c", "address": "fa:16:3e:cf:f4:e9", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaee67ff9-a6", "ovs_interfaceid": "aee67ff9-a673-4687-901d-66e22a39d83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG os_vif [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaee67ff9-a6, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:28 user nova-compute[71354]: INFO os_vif [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=aee67ff9-a673-4687-901d-66e22a39d83c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaee67ff9-a6')
Apr 13 18:08:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Deleting instance files /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc_del
Apr 13 18:08:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Deletion of /opt/stack/data/nova/instances/94db3503-3352-4326-b52a-f8af1061fafc_del complete
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:28 user nova-compute[71354]: INFO nova.compute.manager [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:28 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Deleted allocations for instance 1774abdc-69cc-4755-b62a-c74bc1997944
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-5392b07e-9a59-4ead-a9cf-5a3aea9ec2bb tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "1774abdc-69cc-4755-b62a-c74bc1997944" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.130s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Received event network-vif-deleted-9fdd1b17-9f90-475f-b0a0-17ddea2c8c96 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-unplugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] No waiting events found dispatching network-vif-unplugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-unplugged-aee67ff9-a673-4687-901d-66e22a39d83c for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Acquiring lock "94db3503-3352-4326-b52a-f8af1061fafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] Lock "94db3503-3352-4326-b52a-f8af1061fafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] No waiting events found dispatching network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:28 user nova-compute[71354]: WARNING nova.compute.manager [req-a5c6c30f-07d8-41c7-8d35-b58bae45819c req-c9c951ef-77a2-4aec-9d31-16039008903a service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received unexpected event network-vif-plugged-aee67ff9-a673-4687-901d-66e22a39d83c for instance with vm_state active and task_state deleting.
Apr 13 18:08:28 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:28 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Took 0.89 seconds to deallocate network for instance.
Apr 13 18:08:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:29 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:29 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:29 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Deleted allocations for instance 94db3503-3352-4326-b52a-f8af1061fafc
Apr 13 18:08:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b47aff10-ed53-4456-9425-f6771045fd4c tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "94db3503-3352-4326-b52a-f8af1061fafc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:30 user nova-compute[71354]: DEBUG nova.compute.manager [req-e3a996bf-e01d-44bb-a168-ad4a5e20beff req-c9f2ec8a-42ab-4376-9a61-4e8c352a07e4 service nova] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Received event network-vif-deleted-aee67ff9-a673-4687-901d-66e22a39d83c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-changed-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG nova.compute.manager [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Refreshing instance network info cache due to event network-changed-85b82f0f-9e05-4ff1-aec6-4530a2b04740. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Acquiring lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Acquired lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG nova.network.neutron [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Refreshing network info cache for port 85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:08:39 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409304.9087865, 1774abdc-69cc-4755-b62a-c74bc1997944 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:08:39 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] VM Stopped (Lifecycle Event)
Apr 13 18:08:39 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9fc48f55-ca20-45f5-bffe-8a5a0f201ff9 None None] [instance: 1774abdc-69cc-4755-b62a-c74bc1997944] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updated VIF entry in instance network info cache for port 85b82f0f-9e05-4ff1-aec6-4530a2b04740. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updating instance_info_cache with network_info: [{"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c694762d-1f43-4aaf-98ba-ecb21dda7ba1 req-1bf7c2e4-58b7-4da3-9e31-3f6ba7c72e06 service nova] Releasing lock "refresh_cache-c5342d27-7121-489f-b1b7-c02d664e7fc3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:40 user nova-compute[71354]: INFO nova.compute.manager [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Terminating instance
Apr 13 18:08:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-unplugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] No waiting events found dispatching network-vif-unplugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-unplugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Acquiring lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] No waiting events found dispatching network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:41 user nova-compute[71354]: WARNING nova.compute.manager [req-5d79edf3-90e2-4824-a733-cec70553a3f4 req-6da38c44-5b00-47fd-894d-6db80b2904b7 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received unexpected event network-vif-plugged-85b82f0f-9e05-4ff1-aec6-4530a2b04740 for instance with vm_state active and task_state deleting.
Apr 13 18:08:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Instance destroyed successfully.
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid c5342d27-7121-489f-b1b7-c02d664e7fc3 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-96331133',display_name='tempest-TestVolumeBootPattern-server-96331133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-96331133',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:06:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-g63valc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:06:57Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=c5342d27-7121-489f-b1b7-c02d664e7fc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "address": "fa:16:3e:af:3a:63", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b82f0f-9e", "ovs_interfaceid": "85b82f0f-9e05-4ff1-aec6-4530a2b04740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_vif [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85b82f0f-9e, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:08:41 user nova-compute[71354]: INFO os_vif [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:3a:63,bridge_name='br-int',has_traffic_filtering=True,id=85b82f0f-9e05-4ff1-aec6-4530a2b04740,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b82f0f-9e')
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:08:41 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a69a2d-4a5b-463f-971d-192221a67be3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:08:41 user nova-compute[71354]: No targets found.
Apr 13 18:08:41 user nova-compute[71354]: iSNS:
Apr 13 18:08:41 user nova-compute[71354]: No targets found.
Apr 13 18:08:41 user nova-compute[71354]: STATIC:
Apr 13 18:08:41 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:08:41 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:41 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:41 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:08:41 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:41 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:41 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:08:41 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:41 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:41 user nova-compute[71354]: FIRMWARE:
Apr 13 18:08:41 user nova-compute[71354]: No targets found.
Apr 13 18:08:41 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:08:41 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:08:41 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ade18-d598-4673-a6d9-1a0b3a4b0dda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a21d66-2d53-4256-809c-06ae7ab2e896]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:41 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:41 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:08:41 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:41 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:41 user nova-compute[71354]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:08:41 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50da7ed120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[94938d28-21c1-40ae-a668-c0979b488129]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a4353-49c4-4d6d-85a0-e1b8d331ab17]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f1bb7e-4f24-4c36-a48b-259a25833d2a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4787ba1e-c387-45d1-b4bb-1049b8a81a10]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54a9b2-c853-4c78-88d9-cd8a10f76aff]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c02360-f994-4dc9-aba6-68772ca4bc03]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]
Apr 13 18:08:41 user nova-compute[71354]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.
Apr 13 18:08:41 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34497d8-0499-4d3d-9a4b-ceba3f5253f8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (357ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:08:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Deleting instance files /opt/stack/data/nova/instances/c5342d27-7121-489f-b1b7-c02d664e7fc3_del
Apr 13 18:08:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Deletion of /opt/stack/data/nova/instances/c5342d27-7121-489f-b1b7-c02d664e7fc3_del complete
Apr 13 18:08:41 user nova-compute[71354]: INFO nova.compute.manager [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 13 18:08:41 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:08:41 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:08:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:42 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409307.9840353, 94db3503-3352-4326-b52a-f8af1061fafc => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:08:42 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] VM Stopped (Lifecycle Event)
Apr 13 18:08:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-63a32928-0150-4d34-9fb2-92602d770e39 None None] [instance: 94db3503-3352-4326-b52a-f8af1061fafc] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:43 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:43 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Took 1.69 seconds to deallocate network for instance.
Apr 13 18:08:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-8f71c38d-aa4c-424d-af4d-91ea086919d5 req-ec30b9bb-a100-4bcb-b0db-9e08c13d0218 service nova] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Received event network-vif-deleted-85b82f0f-9e05-4ff1-aec6-4530a2b04740 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:44 user nova-compute[71354]: INFO nova.compute.manager [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Took 0.84 seconds to detach 1 volumes for instance.
Apr 13 18:08:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:44 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:44 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:44 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance c5342d27-7121-489f-b1b7-c02d664e7fc3
Apr 13 18:08:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-093fd21b-4ed4-4c46-a6a9-0d56cfe7d545 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "c5342d27-7121-489f-b1b7-c02d664e7fc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.122s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:08:48 user nova-compute[71354]: INFO nova.compute.claims [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Claim successful on node user
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:08:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.policy [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '414376a2c1204907aadfc83bbe3348e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0b8c72627d48718f4d6657f0c220a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:08:49 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Creating image(s)
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "/opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "/opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "/opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk 1073741824" returned: 0 in 0.054s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Cannot resize image /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'migration_context' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Successfully created port: 06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:50 user nova-compute[71354]: INFO nova.compute.manager [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Terminating instance
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Successfully updated port: 06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing instance network info cache due to event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-4e81a6aa-70da-4f35-a2af-1e91f1b2932f req-7c58d437-b2c7-4f79-8abf-38d43dc0616a service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-unplugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.neutron [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Instance network_info: |[{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Start _get_guest_xml network_info=[{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:08:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:08:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591177314',display_name='tempest-SnapshotDataIntegrityTests-server-591177314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591177314',id=39,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdDeKUtzSJspI72lbnknMzrtvKpB0VydInTJsCsqet7lYHxrl/btstctTwKJWV85y67b/TCTdh6M3eDr2mWkPKceN9b0PJAktNVaLOCELxlNW6m4q+2Lex6DrRkDZPllg==',key_name='tempest-SnapshotDataIntegrityTests-70279965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d0b8c72627d48718f4d6657f0c220a3',ramdisk_id='',reservation_id='r-0so9yfjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1434998905',owner_user_name='tempest-SnapshotDataIntegrityTests-1434998905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:08:49Z,user_data=None,user_id='414376a2c1204907aadfc83bbe3348e7',uuid=e65e349b-11fe-47a6-b47e-e965774b00a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converting VIF {"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.objects.instance [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'pci_devices' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:08:51 user nova-compute[71354]:   <uuid>e65e349b-11fe-47a6-b47e-e965774b00a2</uuid>
Apr 13 18:08:51 user nova-compute[71354]:   <name>instance-00000027</name>
Apr 13 18:08:51 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:08:51 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:08:51 user nova-compute[71354]:   <metadata>
Apr 13 18:08:51 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:08:51 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-591177314</nova:name>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:08:51</nova:creationTime>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:08:51 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:08:51 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:owner>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:user uuid="414376a2c1204907aadfc83bbe3348e7">tempest-SnapshotDataIntegrityTests-1434998905-project-member</nova:user>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:project uuid="3d0b8c72627d48718f4d6657f0c220a3">tempest-SnapshotDataIntegrityTests-1434998905</nova:project>
Apr 13 18:08:51 user nova-compute[71354]:       </nova:owner>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:08:51 user nova-compute[71354]:       <nova:ports>
Apr 13 18:08:51 user nova-compute[71354]:         <nova:port uuid="06a96589-5953-47a0-8e30-efd8d4dff9f3">
Apr 13 18:08:51 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 18:08:51 user nova-compute[71354]:         </nova:port>
Apr 13 18:08:51 user nova-compute[71354]:       </nova:ports>
Apr 13 18:08:51 user nova-compute[71354]:     </nova:instance>
Apr 13 18:08:51 user nova-compute[71354]:   </metadata>
Apr 13 18:08:51 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:08:51 user nova-compute[71354]:     <system>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="serial">e65e349b-11fe-47a6-b47e-e965774b00a2</entry>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="uuid">e65e349b-11fe-47a6-b47e-e965774b00a2</entry>
Apr 13 18:08:51 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:08:51 user nova-compute[71354]:     </system>
Apr 13 18:08:51 user nova-compute[71354]:   </sysinfo>
Apr 13 18:08:51 user nova-compute[71354]:   <os>
Apr 13 18:08:51 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:08:51 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:08:51 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:08:51 user nova-compute[71354]:   </os>
Apr 13 18:08:51 user nova-compute[71354]:   <features>
Apr 13 18:08:51 user nova-compute[71354]:     <acpi/>
Apr 13 18:08:51 user nova-compute[71354]:     <apic/>
Apr 13 18:08:51 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:08:51 user nova-compute[71354]:   </features>
Apr 13 18:08:51 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:08:51 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:08:51 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:08:51 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:08:51 user nova-compute[71354]:   </clock>
Apr 13 18:08:51 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:08:51 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:08:51 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:08:51 user nova-compute[71354]:   </cpu>
Apr 13 18:08:51 user nova-compute[71354]:   <devices>
Apr 13 18:08:51 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:08:51 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:08:51 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk"/>
Apr 13 18:08:51 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:08:51 user nova-compute[71354]:     </disk>
Apr 13 18:08:51 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:08:51 user nova-compute[71354]:       <mac address="fa:16:3e:10:8f:65"/>
Apr 13 18:08:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:08:51 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:08:51 user nova-compute[71354]:       <target dev="tap06a96589-59"/>
Apr 13 18:08:51 user nova-compute[71354]:     </interface>
Apr 13 18:08:51 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:08:51 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/console.log" append="off"/>
Apr 13 18:08:51 user nova-compute[71354]:     </serial>
Apr 13 18:08:51 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:08:51 user nova-compute[71354]:     <video>
Apr 13 18:08:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:08:51 user nova-compute[71354]:     </video>
Apr 13 18:08:51 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:08:51 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:08:51 user nova-compute[71354]:     </rng>
Apr 13 18:08:51 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:08:51 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:08:51 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:08:51 user nova-compute[71354]:     </memballoon>
Apr 13 18:08:51 user nova-compute[71354]:   </devices>
Apr 13 18:08:51 user nova-compute[71354]: </domain>
Apr 13 18:08:51 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591177314',display_name='tempest-SnapshotDataIntegrityTests-server-591177314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591177314',id=39,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdDeKUtzSJspI72lbnknMzrtvKpB0VydInTJsCsqet7lYHxrl/btstctTwKJWV85y67b/TCTdh6M3eDr2mWkPKceN9b0PJAktNVaLOCELxlNW6m4q+2Lex6DrRkDZPllg==',key_name='tempest-SnapshotDataIntegrityTests-70279965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d0b8c72627d48718f4d6657f0c220a3',ramdisk_id='',reservation_id='r-0so9yfjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1434998905',owner_user_name='tempest-SnapshotDataIntegrityTests-1434998905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:08:49Z,user_data=None,user_id='414376a2c1204907aadfc83bbe3348e7',uuid=e65e349b-11fe-47a6-b47e-e965774b00a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converting VIF {"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_vif [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06a96589-59, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06a96589-59, col_values=(('external_ids', {'iface-id': '06a96589-5953-47a0-8e30-efd8d4dff9f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:8f:65', 'vm-uuid': 'e65e349b-11fe-47a6-b47e-e965774b00a2'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:08:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Instance destroyed successfully.
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.objects.instance [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid c4fb17e0-e220-4f95-ac74-70a3d90ecbec {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: INFO os_vif [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59')
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-567832214',display_name='tempest-ServerActionsTestJSON-server-567832214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-567832214',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:04:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-xik0l5et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=c4fb17e0-e220-4f95-ac74-70a3d90ecbec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "f0082b3f-a977-4bff-9b28-dc1618882e72", "address": "fa:16:3e:7d:0d:33", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0082b3f-a9", "ovs_interfaceid": "f0082b3f-a977-4bff-9b28-dc1618882e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_vif [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0082b3f-a9, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:51 user nova-compute[71354]: INFO os_vif [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:0d:33,bridge_name='br-int',has_traffic_filtering=True,id=f0082b3f-a977-4bff-9b28-dc1618882e72,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0082b3f-a9')
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxdcejAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:08:51 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No VIF found with MAC fa:16:3e:10:8f:65, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5059e7-dd07-4009-9e00-941ecc5af907]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:08:51 user nova-compute[71354]: No targets found.
Apr 13 18:08:51 user nova-compute[71354]: iSNS:
Apr 13 18:08:51 user nova-compute[71354]: No targets found.
Apr 13 18:08:51 user nova-compute[71354]: STATIC:
Apr 13 18:08:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081
Apr 13 18:08:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:51 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:08:51 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:08:51 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:08:51 user nova-compute[71354]: FIRMWARE:
Apr 13 18:08:51 user nova-compute[71354]: No targets found.
Apr 13 18:08:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:08:51 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:08:51 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f9cb3-8593-4787-bc2d-7e82a6ef7719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2e94d-f46a-4adc-b330-ca354b94ca6c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 (non-flash)
Apr 13 18:08:51 user nova-compute[71354]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:08:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc355360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081'): ({'sdf'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Removing single pathed devices sdf {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d63f42-20f9-41ff-9a5b-bbd7a013c9a3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae53a76-2e9e-44b3-9870-c0fb21a49ac1]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Flushing IO for device /dev/sdf {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef3878-c828-41b6-8fc9-b30e5adfe8c5]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026ea7c-a917-4513-90e5-14f7c7b3d41f]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] SCSI volumes sdf have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f502c513', '/dev/disk/by-id/scsi-1SCST_BIOf502c513-57baa44b41698699', '/dev/disk/by-id/scsi-23537626161343462') {{(pid=81468) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e0a13-58da-4f17-943a-9e1a2930fc1c]: (4, None) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf198e-f548-442d-b2f7-7497073b8095]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a375a-b25b-46ed-b889-6558efb7b795]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260]
Apr 13 18:08:51 user nova-compute[71354]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081, portal: 172.16.0.220,3260] successful.
Apr 13 18:08:51 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc0e336-b49f-4de4-855a-62f15a62f081 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56864207-8300-4122-924a-e2feb861ab75]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] <== disconnect_volume: return (301ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:08:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Deleting instance files /opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec_del
Apr 13 18:08:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Deletion of /opt/stack/data/nova/instances/c4fb17e0-e220-4f95-ac74-70a3d90ecbec_del complete
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updated VIF entry in instance network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-06a12d85-ee77-425f-bd96-e994c293b6c0 req-ca8db89b-f194-4e3d-8091-011d994d0081 service nova] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:08:51 user nova-compute[71354]: INFO nova.compute.manager [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 18:08:51 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:08:51 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:08:52 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Took 0.69 seconds to deallocate network for instance.
Apr 13 18:08:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] No waiting events found dispatching network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:52 user nova-compute[71354]: WARNING nova.compute.manager [req-a982fe4c-f1cc-460c-a428-6a0fe4f1ae79 req-3b4c8ba8-9e5a-4321-862c-2098f6000931 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received unexpected event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance with vm_state building and task_state spawning.
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-bf360209-270a-4b9c-8cc6-c961610c75cb req-6aab885f-c580-4576-96af-e13ee7f056ef service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-deleted-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Acquiring lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] No waiting events found dispatching network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:52 user nova-compute[71354]: WARNING nova.compute.manager [req-7938a961-4b0a-422e-b5a7-c06164bb9c9d req-c4eab053-f2d6-4493-b2ae-28e63c987711 service nova] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Received unexpected event network-vif-plugged-f0082b3f-a977-4bff-9b28-dc1618882e72 for instance with vm_state active and task_state deleting.
Apr 13 18:08:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:53 user nova-compute[71354]: INFO nova.compute.manager [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Took 0.89 seconds to detach 1 volumes for instance.
Apr 13 18:08:53 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Deleting volume: ccc0e336-b49f-4de4-855a-62f15a62f081 {{(pid=71354) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:08:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:53 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Deleted allocations for instance c4fb17e0-e220-4f95-ac74-70a3d90ecbec
Apr 13 18:08:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-8d262c67-9e97-4bc1-8a8c-534a30b31ba8 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "c4fb17e0-e220-4f95-ac74-70a3d90ecbec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409334.647521, e65e349b-11fe-47a6-b47e-e965774b00a2 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] VM Resumed (Lifecycle Event)
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Instance spawned successfully.
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409334.6488924, e65e349b-11fe-47a6-b47e-e965774b00a2 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] VM Started (Lifecycle Event)
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] No waiting events found dispatching network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:08:54 user nova-compute[71354]: WARNING nova.compute.manager [req-2f009cfc-6a63-4790-91e8-1cbad4fdfed6 req-3f818f1b-fe4e-4ff3-b70a-178621527f5c service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received unexpected event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance with vm_state building and task_state spawning.
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 13 18:08:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:54 user nova-compute[71354]: INFO nova.compute.manager [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Took 6.16 seconds to build instance.
Apr 13 18:08:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-37290636-1fc1-47f6-b94c-4ac24a51fd25 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.260s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:08:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:56 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409321.2161596, c5342d27-7121-489f-b1b7-c02d664e7fc3 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:08:56 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] VM Stopped (Lifecycle Event)
Apr 13 18:08:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7eb77fe9-7b97-4ec1-bee4-305651b3d5d3 None None] [instance: c5342d27-7121-489f-b1b7-c02d664e7fc3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:08:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:08:58 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:08:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:09:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409331.1353343, c4fb17e0-e220-4f95-ac74-70a3d90ecbec => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:09:06 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] VM Stopped (Lifecycle Event)
Apr 13 18:09:06 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:09:06 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8246MB free_disk=26.126667022705078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ecf11e1a-5fa2-4299-b66c-f62dd4d7285d None None] [instance: c4fb17e0-e220-4f95-ac74-70a3d90ecbec] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b75d41c6-6cf6-4162-b49b-c3205c128ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:09:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:09:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:13 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [{"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:09:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-b75d41c6-6cf6-4162-b49b-c3205c128ef4" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:09:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:14 user nova-compute[71354]: INFO nova.compute.manager [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Terminating instance
Apr 13 18:09:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:09:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-unplugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] No waiting events found dispatching network-vif-unplugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-5ca68700-d3f8-46af-ade4-dc95aa49d5e9 req-d4705b0f-1ef1-4ce0-9ec8-77fe0f1b2daf service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-unplugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:09:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Instance destroyed successfully.
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.objects.instance [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lazy-loading 'resources' on Instance uuid db0dac50-5f78-406c-bd56-3d7cdf43d1cb {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1259821018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1259821018',id=15,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d533287b8269447aab81fa7d1312d3f1',ramdisk_id='',reservation_id='r-vu966ylp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:51:38Z,user_data=None,user_id='ec5fc9c7b7234904ba39d403764420b3',uuid=db0dac50-5f78-406c-bd56-3d7cdf43d1cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converting VIF {"id": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "address": "fa:16:3e:8d:0d:3d", "network": {"id": "8d9da666-0149-44ad-8f19-8f10afceca63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-177290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d533287b8269447aab81fa7d1312d3f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1b3297-91", "ovs_interfaceid": "ba1b3297-9105-4622-87e9-fdfa2daa7106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG os_vif [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba1b3297-91, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:09:15 user nova-compute[71354]: INFO os_vif [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:0d:3d,bridge_name='br-int',has_traffic_filtering=True,id=ba1b3297-9105-4622-87e9-fdfa2daa7106,network=Network(8d9da666-0149-44ad-8f19-8f10afceca63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1b3297-91')
Apr 13 18:09:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Deleting instance files /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb_del
Apr 13 18:09:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Deletion of /opt/stack/data/nova/instances/db0dac50-5f78-406c-bd56-3d7cdf43d1cb_del complete
Apr 13 18:09:15 user nova-compute[71354]: INFO nova.compute.manager [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 18:09:15 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:09:15 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:09:16 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Took 0.56 seconds to deallocate network for instance.
Apr 13 18:09:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-120dca0f-35a0-4a44-80d4-bb55d49dc8aa req-3d09c770-a4e5-46d4-b29c-41c135c85ba2 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-deleted-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:09:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:16 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Deleted allocations for instance db0dac50-5f78-406c-bd56-3d7cdf43d1cb
Apr 13 18:09:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-3ed3c1b9-bb20-477f-ac3e-ae7db250752d tempest-ServerBootFromVolumeStableRescueTest-1998717843 tempest-ServerBootFromVolumeStableRescueTest-1998717843-project-member] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.621s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Acquiring lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] Lock "db0dac50-5f78-406c-bd56-3d7cdf43d1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:17 user nova-compute[71354]: DEBUG nova.compute.manager [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] No waiting events found dispatching network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:17 user nova-compute[71354]: WARNING nova.compute.manager [req-697bb209-ddfa-41cc-b268-3547c0409a5c req-5fa22e14-0b65-4b3e-b76a-3f0c5e8e30e7 service nova] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Received unexpected event network-vif-plugged-ba1b3297-9105-4622-87e9-fdfa2daa7106 for instance with vm_state deleted and task_state None.
Apr 13 18:09:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:18 user nova-compute[71354]: INFO nova.compute.manager [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Detaching volume 89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:09:18 user nova-compute[71354]: INFO nova.virt.block_device [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Attempting to driver detach volume 89cc9680-5d37-4798-a49f-0ff6e2466a65 from mountpoint /dev/vdb
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Attempting to detach device vdb from instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:09:18 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:09:18 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:09:18 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:09:18 user nova-compute[71354]:   <serial>89cc9680-5d37-4798-a49f-0ff6e2466a65</serial>
Apr 13 18:09:18 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:09:18 user nova-compute[71354]: </disk>
Apr 13 18:09:18 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:09:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 from the persistent domain config.
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:09:18 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:09:18 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:09:18 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:09:18 user nova-compute[71354]:   <serial>89cc9680-5d37-4798-a49f-0ff6e2466a65</serial>
Apr 13 18:09:18 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:09:18 user nova-compute[71354]: </disk>
Apr 13 18:09:18 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409358.9055166, 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:09:18 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 from the live domain config.
Apr 13 18:09:18 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiozUrZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:09:18 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9573e540-79eb-4ca5-a1ee-ab1e003fab32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:09:18 user nova-compute[71354]: No targets found.
Apr 13 18:09:18 user nova-compute[71354]: iSNS:
Apr 13 18:09:18 user nova-compute[71354]: No targets found.
Apr 13 18:09:18 user nova-compute[71354]: STATIC:
Apr 13 18:09:18 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65
Apr 13 18:09:18 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:09:18 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:09:18 user nova-compute[71354]: FIRMWARE:
Apr 13 18:09:18 user nova-compute[71354]: No targets found.
Apr 13 18:09:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:09:18 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:09:18 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d1f42-c143-4e2c-9de1-22e03991e1ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f568c-cd55-4665-91f5-a6a366cc0968]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:09:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 (non-flash)
Apr 13 18:09:18 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d4356ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:09:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe15e78-ca6b-4a08-9081-99540fbc5cb6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e5a45e-099b-4ed6-bb52-944c63f49c6d]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33be160-1268-41b9-83ae-d705f27e8535]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34eb9f-9a18-4bdb-a587-4e668652f0ab]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f552bad-6134-4503-ba88-2dee297dfb03]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[82695c67-7643-4268-b214-3ccbf23dbf3d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260]
Apr 13 18:09:19 user nova-compute[71354]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65, portal: 172.16.0.220,3260] successful.
Apr 13 18:09:19 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89cc9680-5d37-4798-a49f-0ff6e2466a65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed16df-3773-45d7-a248-8cba973e1d08]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== disconnect_volume: return (272ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:09:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a15d51d3-8e6b-4bfa-8791-5b4e22019cb8 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:30 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409355.4500902, db0dac50-5f78-406c-bd56-3d7cdf43d1cb => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:09:30 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] VM Stopped (Lifecycle Event)
Apr 13 18:09:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-8a6d68e0-841e-4c92-b53a-616a0813bf86 None None] [instance: db0dac50-5f78-406c-bd56-3d7cdf43d1cb] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:09:32 user nova-compute[71354]: INFO nova.compute.claims [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Claim successful on node user
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:09:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:09:32 user nova-compute[71354]: INFO nova.virt.block_device [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Booting with volume 329d61b0-027c-48c2-a0a1-0a93645302ce at /dev/vda
Apr 13 18:09:32 user nova-compute[71354]: DEBUG nova.policy [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[93feaecc-bd3a-4e81-9bfc-65fdfc328cf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[288d3ff2-378b-4616-b01b-dc66cc0f9345]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb61395d-46c8-47b3-8db9-4010a2f3f28c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[98006014-4c03-4ecf-9458-4271fb77e95c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:09:33 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:09:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b05567-be91-4ca6-945c-40ad729b2992]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating existing volume attachment record: 7d07cd86-0ce2-4dd8-b257-6874ff4ed207 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:09:33 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Successfully created port: eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Successfully updated port: eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG nova.compute.manager [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing instance network info cache due to event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Acquiring lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:09:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Instance network_info: |[{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Acquired lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updated VIF entry in instance network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:09:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7cf99d40-aae9-49da-a37f-7d0b0fb1c262 req-30925bb5-96e7-4014-8027-48a922a9a3a9 service nova] Releasing lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:09:37 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Creating image(s)
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Ensure instance console log exists: /opt/stack/data/nova/instances/265cff53-3a62-456a-92fd-98025a195518/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Start _get_guest_xml network_info=[{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '7d07cd86-0ce2-4dd8-b257-6874ff4ed207', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '265cff53-3a62-456a-92fd-98025a195518', 'attached_at': '', 'detached_at': '', 'volume_id': '329d61b0-027c-48c2-a0a1-0a93645302ce', 'serial': '329d61b0-027c-48c2-a0a1-0a93645302ce'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:09:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:09:37 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:09:37 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:09:37 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:09:37 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb974b-dad0-4fed-aa96-80923cdfbf3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:09:37 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[60760908-d8d2-47da-9aff-66d6ff194c48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce] added
Apr 13 18:09:37 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdce2b-0431-4d4d-9ce6-fa322abafb9b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7cab0-1393-4fcb-ad77-847243700486]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pstboqQF {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pstboqQF" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089a6e0-a7c1-4553-968a-843aa87578c9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pstboqQF'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c93a9a-e6c8-46a9-b791-143015442756]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64548722-f7f4-427a-bf85-ee496850cc96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:09:37 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:09:37 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:09:37 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 18:09:37 user nova-compute[71354]: 
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06869db-3690-473a-903b-a19fcb842c96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]
Apr 13 18:09:37 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.
Apr 13 18:09:37 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb8846-823b-4438-9540-27de17100dfb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9105cc88-b9c4-47b0-9c79-842ea43e7b07]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:09:37 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:09:37 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f283b-6fad-45ca-82fe-36047cce34b9]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:09:37 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:09:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:09:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23135303133396535', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:09:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135303133396535', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-15971703',display_name='tempest-TestVolumeBootPattern-server-15971703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-15971703',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-8ll8vb0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:09:33Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=265cff53-3a62-456a-92fd-98025a195518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.objects.instance [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid 265cff53-3a62-456a-92fd-98025a195518 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:09:39 user nova-compute[71354]:   <uuid>265cff53-3a62-456a-92fd-98025a195518</uuid>
Apr 13 18:09:39 user nova-compute[71354]:   <name>instance-00000028</name>
Apr 13 18:09:39 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:09:39 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:09:39 user nova-compute[71354]:   <metadata>
Apr 13 18:09:39 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:09:39 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:09:39 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-server-15971703</nova:name>
Apr 13 18:09:39 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:09:37</nova:creationTime>
Apr 13 18:09:39 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:09:39 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:09:39 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:09:39 user nova-compute[71354]:       <nova:owner>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 18:09:39 user nova-compute[71354]:       </nova:owner>
Apr 13 18:09:39 user nova-compute[71354]:       <nova:ports>
Apr 13 18:09:39 user nova-compute[71354]:         <nova:port uuid="eb4d0c83-d6e6-424e-a956-d52ece4d3228">
Apr 13 18:09:39 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 18:09:39 user nova-compute[71354]:         </nova:port>
Apr 13 18:09:39 user nova-compute[71354]:       </nova:ports>
Apr 13 18:09:39 user nova-compute[71354]:     </nova:instance>
Apr 13 18:09:39 user nova-compute[71354]:   </metadata>
Apr 13 18:09:39 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:09:39 user nova-compute[71354]:     <system>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="serial">265cff53-3a62-456a-92fd-98025a195518</entry>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="uuid">265cff53-3a62-456a-92fd-98025a195518</entry>
Apr 13 18:09:39 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:09:39 user nova-compute[71354]:     </system>
Apr 13 18:09:39 user nova-compute[71354]:   </sysinfo>
Apr 13 18:09:39 user nova-compute[71354]:   <os>
Apr 13 18:09:39 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:09:39 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:09:39 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:09:39 user nova-compute[71354]:   </os>
Apr 13 18:09:39 user nova-compute[71354]:   <features>
Apr 13 18:09:39 user nova-compute[71354]:     <acpi/>
Apr 13 18:09:39 user nova-compute[71354]:     <apic/>
Apr 13 18:09:39 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:09:39 user nova-compute[71354]:   </features>
Apr 13 18:09:39 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:09:39 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:09:39 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:09:39 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:09:39 user nova-compute[71354]:   </clock>
Apr 13 18:09:39 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:09:39 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:09:39 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:09:39 user nova-compute[71354]:   </cpu>
Apr 13 18:09:39 user nova-compute[71354]:   <devices>
Apr 13 18:09:39 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:09:39 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:09:39 user nova-compute[71354]:       <source dev="/dev/sdb"/>
Apr 13 18:09:39 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:09:39 user nova-compute[71354]:       <serial>329d61b0-027c-48c2-a0a1-0a93645302ce</serial>
Apr 13 18:09:39 user nova-compute[71354]:     </disk>
Apr 13 18:09:39 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:09:39 user nova-compute[71354]:       <mac address="fa:16:3e:9b:90:00"/>
Apr 13 18:09:39 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:09:39 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:09:39 user nova-compute[71354]:       <target dev="tapeb4d0c83-d6"/>
Apr 13 18:09:39 user nova-compute[71354]:     </interface>
Apr 13 18:09:39 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:09:39 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/265cff53-3a62-456a-92fd-98025a195518/console.log" append="off"/>
Apr 13 18:09:39 user nova-compute[71354]:     </serial>
Apr 13 18:09:39 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:09:39 user nova-compute[71354]:     <video>
Apr 13 18:09:39 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:09:39 user nova-compute[71354]:     </video>
Apr 13 18:09:39 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:09:39 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:09:39 user nova-compute[71354]:     </rng>
Apr 13 18:09:39 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:09:39 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:09:39 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:09:39 user nova-compute[71354]:     </memballoon>
Apr 13 18:09:39 user nova-compute[71354]:   </devices>
Apr 13 18:09:39 user nova-compute[71354]: </domain>
Apr 13 18:09:39 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-15971703',display_name='tempest-TestVolumeBootPattern-server-15971703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-15971703',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-8ll8vb0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:09:33Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=265cff53-3a62-456a-92fd-98025a195518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG os_vif [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb4d0c83-d6, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb4d0c83-d6, col_values=(('external_ids', {'iface-id': 'eb4d0c83-d6e6-424e-a956-d52ece4d3228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:90:00', 'vm-uuid': '265cff53-3a62-456a-92fd-98025a195518'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:39 user nova-compute[71354]: INFO os_vif [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6')
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:09:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:9b:90:00, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] No waiting events found dispatching network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:40 user nova-compute[71354]: WARNING nova.compute.manager [req-780ce46f-aa4a-42ca-ac6e-5a6f061e761f req-e6f8d9af-e385-4173-baa5-72213069ed53 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received unexpected event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance with vm_state building and task_state spawning.
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:40 user nova-compute[71354]: INFO nova.compute.manager [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Terminating instance
Apr 13 18:09:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-unplugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] No waiting events found dispatching network-vif-unplugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.compute.manager [req-a9e2135e-06da-458a-b500-7d1a23a63cd7 req-b2b5c038-d5ec-4826-80b6-2926561b7772 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-unplugged-54109c72-9d87-44b7-a358-864c31b9c96d for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:09:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Instance destroyed successfully.
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lazy-loading 'resources' on Instance uuid b75d41c6-6cf6-4162-b49b-c3205c128ef4 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-935220888',display_name='tempest-ServerActionsTestJSON-server-935220888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-935220888',id=31,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ftAXSlD2WGAsGxxCbOozzFE2Gmj5Nx7hixTOUC1EGekQu7qUVnrpl/sUs4ehwSTvfEGuLUI6CDqEO9/ytA4ppm+28yvD7cd5XgeB9Te3aLhdkYxqxcmL4mtoPbr59ag==',key_name='tempest-keypair-1272899020',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e743d5e6104b55b57b4754fe7e668a',ramdisk_id='',reservation_id='r-806pct33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1530883669',owner_user_name='tempest-ServerActionsTestJSON-1530883669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f796555c0e242d091502725ec595c0f',uuid=b75d41c6-6cf6-4162-b49b-c3205c128ef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converting VIF {"id": "54109c72-9d87-44b7-a358-864c31b9c96d", "address": "fa:16:3e:a1:40:55", "network": {"id": "10638cc2-22a6-4aac-b79a-2baa9327e1bc", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2011315058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e743d5e6104b55b57b4754fe7e668a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54109c72-9d", "ovs_interfaceid": "54109c72-9d87-44b7-a358-864c31b9c96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG os_vif [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54109c72-9d, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:09:41 user nova-compute[71354]: INFO os_vif [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:40:55,bridge_name='br-int',has_traffic_filtering=True,id=54109c72-9d87-44b7-a358-864c31b9c96d,network=Network(10638cc2-22a6-4aac-b79a-2baa9327e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54109c72-9d')
Apr 13 18:09:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Deleting instance files /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4_del
Apr 13 18:09:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Deletion of /opt/stack/data/nova/instances/b75d41c6-6cf6-4162-b49b-c3205c128ef4_del complete
Apr 13 18:09:41 user nova-compute[71354]: INFO nova.compute.manager [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 13 18:09:41 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:09:41 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Took 0.44 seconds to deallocate network for instance.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Deleted allocations for instance b75d41c6-6cf6-4162-b49b-c3205c128ef4
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-afea2396-c6c2-4a60-be57-5b53e537c821 tempest-ServerActionsTestJSON-1530883669 tempest-ServerActionsTestJSON-1530883669-project-member] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.458s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409382.5051322, 265cff53-3a62-456a-92fd-98025a195518 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] VM Resumed (Lifecycle Event)
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] Instance spawned successfully.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] No waiting events found dispatching network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:42 user nova-compute[71354]: WARNING nova.compute.manager [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received unexpected event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance with vm_state building and task_state spawning.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-81c38ea0-8ee7-40c3-a374-15f86667811c req-37f40fce-5136-4594-adff-11bc54f48f74 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-deleted-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409382.5064998, 265cff53-3a62-456a-92fd-98025a195518 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] VM Started (Lifecycle Event)
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:42 user nova-compute[71354]: INFO nova.compute.manager [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Took 10.22 seconds to build instance.
Apr 13 18:09:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69423789-15a3-42a4-8a36-c3fc4e0389fd tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.323s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:09:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Acquiring lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:09:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:09:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] Lock "b75d41c6-6cf6-4162-b49b-c3205c128ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:09:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] No waiting events found dispatching network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:09:43 user nova-compute[71354]: WARNING nova.compute.manager [req-c24d6954-6271-4eae-9b02-58c09a6a2368 req-b8b07398-86c1-4484-9823-7fff2709b559 service nova] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Received unexpected event network-vif-plugged-54109c72-9d87-44b7-a358-864c31b9c96d for instance with vm_state deleted and task_state None.
Apr 13 18:09:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409381.4788694, b75d41c6-6cf6-4162-b49b-c3205c128ef4 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:09:56 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] VM Stopped (Lifecycle Event)
Apr 13 18:09:56 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69938504-422d-4857-bd59-a77b15cdf3fe None None] [instance: b75d41c6-6cf6-4162-b49b-c3205c128ef4] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:09:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:09:59 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:09:59 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:10:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:10:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:10:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=26.216156005859375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 265cff53-3a62-456a-92fd-98025a195518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:10:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:08 user nova-compute[71354]: INFO nova.compute.manager [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Terminating instance
Apr 13 18:10:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-unplugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] No waiting events found dispatching network-vif-unplugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-a3917b08-9ff9-426d-9776-4c21b7bd30ad req-6abfeca0-f01d-463a-aedc-0cd7d92be29b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-unplugged-e3e2fd87-b819-444d-afc1-f02005f3cedc for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:10:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Instance destroyed successfully.
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.objects.instance [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'resources' on Instance uuid 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1571357563',display_name='tempest-AttachVolumeNegativeTest-server-1571357563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1571357563',id=36,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdOxamXsTXlK9OaACIf8bLScnUWpSxIKftQ3YDg8S6W9dnCJz+Vc57VKW/FCcFWKyA9NE0qEvzGl+mNUFxlstDlQsrnA13xf1V3Tn1dbJC7Ms2tKG6E+lwchAc6RaZqgg==',key_name='tempest-keypair-577728192',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:04:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-44he5cge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=19b65bfd-ef04-44fc-b5bf-f4742705b8b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "address": "fa:16:3e:d4:c0:67", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e2fd87-b8", "ovs_interfaceid": "e3e2fd87-b819-444d-afc1-f02005f3cedc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG os_vif [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3e2fd87-b8, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:10:09 user nova-compute[71354]: INFO os_vif [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:c0:67,bridge_name='br-int',has_traffic_filtering=True,id=e3e2fd87-b819-444d-afc1-f02005f3cedc,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e2fd87-b8')
Apr 13 18:10:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Deleting instance files /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5_del
Apr 13 18:10:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Deletion of /opt/stack/data/nova/instances/19b65bfd-ef04-44fc-b5bf-f4742705b8b5_del complete
Apr 13 18:10:09 user nova-compute[71354]: INFO nova.compute.manager [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 13 18:10:09 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:10:09 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:10:10 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Took 0.73 seconds to deallocate network for instance.
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-deleted-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:10:10 user nova-compute[71354]: INFO nova.compute.manager [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Neutron deleted interface e3e2fd87-b819-444d-afc1-f02005f3cedc; detaching it from the instance and deleting it from the info cache
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.network.neutron [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.compute.manager [req-e2f852e2-c42d-49f4-bae2-0fd0c01d1f3a req-ad64b0aa-d515-4be4-a7fc-8ab01824b0f7 service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Detach interface failed, port_id=e3e2fd87-b819-444d-afc1-f02005f3cedc, reason: Instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:10:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:10 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Deleted allocations for instance 19b65bfd-ef04-44fc-b5bf-f4742705b8b5
Apr 13 18:10:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-1c12ccbe-8873-4aeb-bd0e-c1ce7b0bb776 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:10:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Acquiring lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] Lock "19b65bfd-ef04-44fc-b5bf-f4742705b8b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:11 user nova-compute[71354]: DEBUG nova.compute.manager [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] No waiting events found dispatching network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:10:11 user nova-compute[71354]: WARNING nova.compute.manager [req-4828f81c-7ba6-4db1-b199-31c67d4bb097 req-dd6ff66f-6e4c-45a6-b38a-818f120d050b service nova] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Received unexpected event network-vif-plugged-e3e2fd87-b819-444d-afc1-f02005f3cedc for instance with vm_state deleted and task_state None.
Apr 13 18:10:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:10:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:10:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:10:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:24 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409409.8271084, 19b65bfd-ef04-44fc-b5bf-f4742705b8b5 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:10:24 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] VM Stopped (Lifecycle Event)
Apr 13 18:10:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b36b3adc-3049-47b4-86c9-c396b58dbe72 None None] [instance: 19b65bfd-ef04-44fc-b5bf-f4742705b8b5] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:10:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:10:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:10:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing instance network info cache due to event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.objects.instance [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:10:42 user nova-compute[71354]: INFO nova.compute.manager [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attaching volume 13f2fc2e-83cf-4e78-bfdb-e58d09857b58 to /dev/vdb
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updated VIF entry in instance network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.utils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3634f9db-571b-4e6d-939f-30ca08ef2eeb req-9c5ef067-26c6-46e8-9a06-0c2de8651a61 service nova] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e33d3-0d93-4435-8047-3c1936bea665]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280e4de-4ead-4260-a566-7f1f1b3c93cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56ecde1-1a70-4be4-9563-8fad77d70673]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f974c89-c7a1-4998-afb1-dab3f280e879]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:10:42 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:10:42 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[53790e50-4253-4093-9b7e-9dfe76a4dfc7]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG os_brick.utils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating existing volume attachment record: 69a03dc9-9faf-49fb-98a2-96aacf2ac7b9 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:10:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peKJLjOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:10:47 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:10:47 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:10:47 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e66b43-88b0-456b-8fd1-60abb26b3e0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:10:47 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aa97b4-8b76-41b9-8837-968159daf220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58] added
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[68afd484-c309-4d0a-b34c-a659139656ec]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce36c5f-fa6f-4a56-9510-a40ecb5a17cf]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peKJLjOt {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peKJLjOt" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f5b93-eb45-4a40-acb4-8fd2c8bc7714]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peKJLjOt'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd7df3-45f7-4cbe-b1a0-0afdc98c5ca7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c801e1-0cb8-4736-9e34-3f6710dbe55a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200074d-5eda-45d5-b99d-d4bd11d1e375]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260]
Apr 13 18:10:47 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260] successful.
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c36048-3a69-4777-9db5-1c6dca57a07a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad86d4-48fe-46a7-99bf-422b317f2159]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:10:47 user nova-compute[71354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:10:47 user nova-compute[71354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)
Apr 13 18:10:47 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43b244-6e25-49f8-8b41-b0e3e0187500]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:10:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peKJLjOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23361313765666339', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361313765666339', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG nova.objects.instance [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:10:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:10:48 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:10:48 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:10:48 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:10:48 user nova-compute[71354]:   <serial>13f2fc2e-83cf-4e78-bfdb-e58d09857b58</serial>
Apr 13 18:10:48 user nova-compute[71354]: </disk>
Apr 13 18:10:48 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:10:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:10:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:10:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No VIF found with MAC fa:16:3e:10:8f:65, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:10:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-6d6c5ff2-3716-4c4a-a1e3-12f539db285c tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.760s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:10:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:10:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:00 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:01 user nova-compute[71354]: INFO nova.compute.manager [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Detaching volume 13f2fc2e-83cf-4e78-bfdb-e58d09857b58
Apr 13 18:11:01 user nova-compute[71354]: INFO nova.virt.block_device [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attempting to driver detach volume 13f2fc2e-83cf-4e78-bfdb-e58d09857b58 from mountpoint /dev/vdb
Apr 13 18:11:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Attempting to detach device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:11:01 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:11:01 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:11:01 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:11:01 user nova-compute[71354]:   <serial>13f2fc2e-83cf-4e78-bfdb-e58d09857b58</serial>
Apr 13 18:11:01 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:11:01 user nova-compute[71354]: </disk>
Apr 13 18:11:01 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:11:01 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config.
Apr 13 18:11:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:11:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:11:01 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:11:01 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:11:01 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:11:01 user nova-compute[71354]:   <serial>13f2fc2e-83cf-4e78-bfdb-e58d09857b58</serial>
Apr 13 18:11:01 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:11:01 user nova-compute[71354]: </disk>
Apr 13 18:11:01 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409462.2663443, e65e349b-11fe-47a6-b47e-e965774b00a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:11:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config.
Apr 13 18:11:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peKJLjOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:11:02 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5b23b5-dea0-47da-8720-ab0b4f0c0149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:11:02 user nova-compute[71354]: No targets found.
Apr 13 18:11:02 user nova-compute[71354]: iSNS:
Apr 13 18:11:02 user nova-compute[71354]: No targets found.
Apr 13 18:11:02 user nova-compute[71354]: STATIC:
Apr 13 18:11:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58
Apr 13 18:11:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:11:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:11:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:11:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:11:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:11:02 user nova-compute[71354]: FIRMWARE:
Apr 13 18:11:02 user nova-compute[71354]: No targets found.
Apr 13 18:11:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:11:02 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:11:02 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b207d-50b7-4281-9f1c-0fe9f92e9751]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[10736b3a-1c72-4dce-8547-dfb66626e205]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:02 user nova-compute[71354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)
Apr 13 18:11:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:02 user nova-compute[71354]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 (non-flash)
Apr 13 18:11:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d41ead40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ec97f-46fa-4369-b585-50c809082544]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275d06f-c87c-4b98-a168-7401135a41a2]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cdaa6b-4fc2-43bd-9528-b7e0bf407cce]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae98e3-3328-439a-93a6-8f908d225b16]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ccd84-0783-43ae-8045-1530e4866f57]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023761d-0396-4d94-bfaa-9d0c4c354003]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260]
Apr 13 18:11:02 user nova-compute[71354]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58, portal: 172.16.0.220,3260] successful.
Apr 13 18:11:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f2fc2e-83cf-4e78-bfdb-e58d09857b58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[11565ca4-6d63-449c-89f9-9136bec2fceb]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== disconnect_volume: return (317ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:11:03 user nova-compute[71354]: INFO nova.compute.claims [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Claim successful on node user
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.objects.instance [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-9edf6d4e-0005-4835-9327-169da3101be8 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.770s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:11:03 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.policy [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:11:03 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Creating image(s)
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "/opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.141s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk 1073741824" returned: 0 in 0.057s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.156s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Cannot resize image /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'migration_context' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Ensure instance console log exists: /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Successfully created port: 1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:11:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Successfully updated port: 1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquired lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-changed-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Refreshing instance network info cache due to event network-changed-1e990464-f0e7-451e-9833-ca1c228c892a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Acquiring lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating instance_info_cache with network_info: [{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Releasing lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Instance network_info: |[{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Acquired lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Refreshing network info cache for port 1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Start _get_guest_xml network_info=[{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:11:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-773936371',display_name='tempest-AttachVolumeNegativeTest-server-773936371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-773936371',id=41,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYxg2XyF7Adew+qh4/sZlHk9cfH5MC0/RGhywZ7WdUIWZ70Ee4BBYdRrK50BUnnUDE6EVAThjcmXg8SHgoZWM22UZrP+EyGmlzYkuUKI2lw7JBwCLxeWg66VmuLKH+WFw==',key_name='tempest-keypair-1291612920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-12caypvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=726eed4a-ac9c-4cef-aa8a-2600b26c1f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'pci_devices' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:11:05 user nova-compute[71354]:   <uuid>726eed4a-ac9c-4cef-aa8a-2600b26c1f81</uuid>
Apr 13 18:11:05 user nova-compute[71354]:   <name>instance-00000029</name>
Apr 13 18:11:05 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:11:05 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:11:05 user nova-compute[71354]:   <metadata>
Apr 13 18:11:05 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:11:05 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-773936371</nova:name>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:11:05</nova:creationTime>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:11:05 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:11:05 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:owner>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:user uuid="0ac81be2a2db40b2acbae911db8086ca">tempest-AttachVolumeNegativeTest-1374126190-project-member</nova:user>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:project uuid="c5bfb2b952aa4fd8a66d4eb5aa052e97">tempest-AttachVolumeNegativeTest-1374126190</nova:project>
Apr 13 18:11:05 user nova-compute[71354]:       </nova:owner>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:11:05 user nova-compute[71354]:       <nova:ports>
Apr 13 18:11:05 user nova-compute[71354]:         <nova:port uuid="1e990464-f0e7-451e-9833-ca1c228c892a">
Apr 13 18:11:05 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:11:05 user nova-compute[71354]:         </nova:port>
Apr 13 18:11:05 user nova-compute[71354]:       </nova:ports>
Apr 13 18:11:05 user nova-compute[71354]:     </nova:instance>
Apr 13 18:11:05 user nova-compute[71354]:   </metadata>
Apr 13 18:11:05 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:11:05 user nova-compute[71354]:     <system>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="serial">726eed4a-ac9c-4cef-aa8a-2600b26c1f81</entry>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="uuid">726eed4a-ac9c-4cef-aa8a-2600b26c1f81</entry>
Apr 13 18:11:05 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:11:05 user nova-compute[71354]:     </system>
Apr 13 18:11:05 user nova-compute[71354]:   </sysinfo>
Apr 13 18:11:05 user nova-compute[71354]:   <os>
Apr 13 18:11:05 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:11:05 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:11:05 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:11:05 user nova-compute[71354]:   </os>
Apr 13 18:11:05 user nova-compute[71354]:   <features>
Apr 13 18:11:05 user nova-compute[71354]:     <acpi/>
Apr 13 18:11:05 user nova-compute[71354]:     <apic/>
Apr 13 18:11:05 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:11:05 user nova-compute[71354]:   </features>
Apr 13 18:11:05 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:11:05 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:11:05 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:11:05 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:11:05 user nova-compute[71354]:   </clock>
Apr 13 18:11:05 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:11:05 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:11:05 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:11:05 user nova-compute[71354]:   </cpu>
Apr 13 18:11:05 user nova-compute[71354]:   <devices>
Apr 13 18:11:05 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:11:05 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:11:05 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk"/>
Apr 13 18:11:05 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:11:05 user nova-compute[71354]:     </disk>
Apr 13 18:11:05 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:11:05 user nova-compute[71354]:       <mac address="fa:16:3e:b3:77:55"/>
Apr 13 18:11:05 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:05 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:11:05 user nova-compute[71354]:       <target dev="tap1e990464-f0"/>
Apr 13 18:11:05 user nova-compute[71354]:     </interface>
Apr 13 18:11:05 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:11:05 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/console.log" append="off"/>
Apr 13 18:11:05 user nova-compute[71354]:     </serial>
Apr 13 18:11:05 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:11:05 user nova-compute[71354]:     <video>
Apr 13 18:11:05 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:05 user nova-compute[71354]:     </video>
Apr 13 18:11:05 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:11:05 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:11:05 user nova-compute[71354]:     </rng>
Apr 13 18:11:05 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:11:05 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:11:05 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:11:05 user nova-compute[71354]:     </memballoon>
Apr 13 18:11:05 user nova-compute[71354]:   </devices>
Apr 13 18:11:05 user nova-compute[71354]: </domain>
Apr 13 18:11:05 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-773936371',display_name='tempest-AttachVolumeNegativeTest-server-773936371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-773936371',id=41,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYxg2XyF7Adew+qh4/sZlHk9cfH5MC0/RGhywZ7WdUIWZ70Ee4BBYdRrK50BUnnUDE6EVAThjcmXg8SHgoZWM22UZrP+EyGmlzYkuUKI2lw7JBwCLxeWg66VmuLKH+WFw==',key_name='tempest-keypair-1291612920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-12caypvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=726eed4a-ac9c-4cef-aa8a-2600b26c1f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG os_vif [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e990464-f0, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e990464-f0, col_values=(('external_ids', {'iface-id': '1e990464-f0e7-451e-9833-ca1c228c892a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:77:55', 'vm-uuid': '726eed4a-ac9c-4cef-aa8a-2600b26c1f81'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:05 user nova-compute[71354]: INFO os_vif [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0')
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:11:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:b3:77:55, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updated VIF entry in instance network info cache for port 1e990464-f0e7-451e-9833-ca1c228c892a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating instance_info_cache with network_info: [{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-32402768-b41c-4936-a4be-a70b7aeef16e req-28caf32d-e15a-479a-8f35-f2f8fe0334eb service nova] Releasing lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] No waiting events found dispatching network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:07 user nova-compute[71354]: WARNING nova.compute.manager [req-c9de260c-ecd4-46e8-8c10-35b83ef95eca req-635426e2-10be-47b8-92b7-aa6be8e08fd2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received unexpected event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a for instance with vm_state building and task_state spawning.
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409469.348755, 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] VM Resumed (Lifecycle Event)
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] No waiting events found dispatching network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:09 user nova-compute[71354]: WARNING nova.compute.manager [req-09a57a5c-c1c7-42a4-924b-b96bfc119509 req-a9e94e37-7946-4417-a5ca-7bbacf30996d service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received unexpected event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a for instance with vm_state building and task_state spawning.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=26.22148895263672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Instance spawned successfully.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409469.3515878, 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] VM Started (Lifecycle Event)
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 265cff53-3a62-456a-92fd-98025a195518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:09 user nova-compute[71354]: INFO nova.compute.manager [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Took 6.73 seconds to build instance.
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ab680c0e-e071-4c0f-927a-18330e146e1f tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.870s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:11:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:11:16 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:11:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing instance network info cache due to event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Acquiring lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Acquired lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updated VIF entry in instance network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb1e719b-0259-42ac-acd5-01e116128f72 req-496df9ce-b832-497d-94a7-c60728b71c03 service nova] Releasing lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:11:32 user nova-compute[71354]: INFO nova.compute.claims [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Claim successful on node user
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:11:32 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:11:32 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:11:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:32 user nova-compute[71354]: INFO nova.virt.block_device [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Booting with volume 042b8df2-6b74-4c93-ba2b-2de2831316d4 at /dev/vda
Apr 13 18:11:33 user nova-compute[71354]: DEBUG nova.policy [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd4d2b21dda452dab66c1973c3beec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f789d52faa469c802d7c1281ed8c82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fe39e-1940-48f5-b397-d36f024c36af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78576e-aca5-4793-b2fb-9ffb62bc87c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454ab6a-5f1e-45bb-b481-c719ba3abcab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[58337723-3d92-407e-9b41-7eb50bc26935]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:11:33 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:11:33 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6133513-aeb1-4982-9f77-ebf28cd382fe]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG os_brick.utils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:11:33 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating existing volume attachment record: 624d0378-9511-41c1-8004-beaa8b16f7f2 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:11:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Successfully created port: ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:11:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Successfully updated port: ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:11:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:34 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquired lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:34 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.compute.manager [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing instance network info cache due to event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Acquiring lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.network.neutron [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Releasing lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Instance network_info: |[{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Acquired lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updated VIF entry in instance network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG nova.network.neutron [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:35 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c80f438e-62e1-4433-8589-cfcb035e39ed req-567d3bbe-e2a7-416e-9ed0-8e16fba5da51 service nova] Releasing lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:11:38 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Creating image(s)
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Did not create local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Ensure instance console log exists: /opt/stack/data/nova/instances/d350bf71-885d-4f3e-acdc-0136ab1469bd/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Start _get_guest_xml network_info=[{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '624d0378-9511-41c1-8004-beaa8b16f7f2', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmLtsyuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd350bf71-885d-4f3e-acdc-0136ab1469bd', 'attached_at': '', 'detached_at': '', 'volume_id': '042b8df2-6b74-4c93-ba2b-2de2831316d4', 'serial': '042b8df2-6b74-4c93-ba2b-2de2831316d4'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:11:38 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:38 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmLtsyuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:11:38 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:11:38 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:11:38 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8437209d-e46c-48e6-a249-40315f4dcfc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:11:38 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72efcce9-8ef9-40cf-9361-ac635fff8d45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4] added
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9dd8fb-da60-42b5-9635-10907de276c8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d157ad-c81b-4bce-8517-2b561de4f3e1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmLtsyuT {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmLtsyuT" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b261830-57ec-4d61-be1e-9b544d21cdcf]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wmLtsyuT'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb2353-355f-4461-b99c-fe582ab7a521]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7f1c10-82fe-4289-bed1-e2cd2bd171ef]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790840f-7e0f-4802-aa9b-57d16b8fafa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260]
Apr 13 18:11:38 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260] successful.
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1063e1-37c8-4484-ad93-90c09b4421aa]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07ea7a1-3fb7-46aa-a9f6-2479bf0b3462]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:38 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:38 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:38 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc80333-b0b7-47d3-beb8-d65288cccaab]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:11:38 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmLtsyuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23966393735343436', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393735343436', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1973954414',display_name='tempest-TestVolumeBootPattern-server-1973954414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1973954414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-puksh8gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:33Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=d350bf71-885d-4f3e-acdc-0136ab1469bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'pci_devices' on Instance uuid d350bf71-885d-4f3e-acdc-0136ab1469bd {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:11:39 user nova-compute[71354]:   <uuid>d350bf71-885d-4f3e-acdc-0136ab1469bd</uuid>
Apr 13 18:11:39 user nova-compute[71354]:   <name>instance-0000002a</name>
Apr 13 18:11:39 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:11:39 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:11:39 user nova-compute[71354]:   <metadata>
Apr 13 18:11:39 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:11:39 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:11:39 user nova-compute[71354]:       <nova:name>tempest-TestVolumeBootPattern-server-1973954414</nova:name>
Apr 13 18:11:39 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:11:38</nova:creationTime>
Apr 13 18:11:39 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:11:39 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:11:39 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:11:39 user nova-compute[71354]:       <nova:owner>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:user uuid="1cd4d2b21dda452dab66c1973c3beec1">tempest-TestVolumeBootPattern-1858052268-project-member</nova:user>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:project uuid="25f789d52faa469c802d7c1281ed8c82">tempest-TestVolumeBootPattern-1858052268</nova:project>
Apr 13 18:11:39 user nova-compute[71354]:       </nova:owner>
Apr 13 18:11:39 user nova-compute[71354]:       <nova:ports>
Apr 13 18:11:39 user nova-compute[71354]:         <nova:port uuid="ff75bab4-c13b-465f-b2e8-ca4c8f860d5a">
Apr 13 18:11:39 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 18:11:39 user nova-compute[71354]:         </nova:port>
Apr 13 18:11:39 user nova-compute[71354]:       </nova:ports>
Apr 13 18:11:39 user nova-compute[71354]:     </nova:instance>
Apr 13 18:11:39 user nova-compute[71354]:   </metadata>
Apr 13 18:11:39 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:11:39 user nova-compute[71354]:     <system>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="serial">d350bf71-885d-4f3e-acdc-0136ab1469bd</entry>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="uuid">d350bf71-885d-4f3e-acdc-0136ab1469bd</entry>
Apr 13 18:11:39 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:11:39 user nova-compute[71354]:     </system>
Apr 13 18:11:39 user nova-compute[71354]:   </sysinfo>
Apr 13 18:11:39 user nova-compute[71354]:   <os>
Apr 13 18:11:39 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:11:39 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:11:39 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:11:39 user nova-compute[71354]:   </os>
Apr 13 18:11:39 user nova-compute[71354]:   <features>
Apr 13 18:11:39 user nova-compute[71354]:     <acpi/>
Apr 13 18:11:39 user nova-compute[71354]:     <apic/>
Apr 13 18:11:39 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:11:39 user nova-compute[71354]:   </features>
Apr 13 18:11:39 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:11:39 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:11:39 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:11:39 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:11:39 user nova-compute[71354]:   </clock>
Apr 13 18:11:39 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:11:39 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:11:39 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:11:39 user nova-compute[71354]:   </cpu>
Apr 13 18:11:39 user nova-compute[71354]:   <devices>
Apr 13 18:11:39 user nova-compute[71354]:     <disk type="block" device="disk">
Apr 13 18:11:39 user nova-compute[71354]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:11:39 user nova-compute[71354]:       <source dev="/dev/sdc"/>
Apr 13 18:11:39 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:11:39 user nova-compute[71354]:       <serial>042b8df2-6b74-4c93-ba2b-2de2831316d4</serial>
Apr 13 18:11:39 user nova-compute[71354]:     </disk>
Apr 13 18:11:39 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:11:39 user nova-compute[71354]:       <mac address="fa:16:3e:b6:9e:cc"/>
Apr 13 18:11:39 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:39 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:11:39 user nova-compute[71354]:       <target dev="tapff75bab4-c1"/>
Apr 13 18:11:39 user nova-compute[71354]:     </interface>
Apr 13 18:11:39 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:11:39 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/d350bf71-885d-4f3e-acdc-0136ab1469bd/console.log" append="off"/>
Apr 13 18:11:39 user nova-compute[71354]:     </serial>
Apr 13 18:11:39 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:11:39 user nova-compute[71354]:     <video>
Apr 13 18:11:39 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:39 user nova-compute[71354]:     </video>
Apr 13 18:11:39 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:11:39 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:11:39 user nova-compute[71354]:     </rng>
Apr 13 18:11:39 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:11:39 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:11:39 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:11:39 user nova-compute[71354]:     </memballoon>
Apr 13 18:11:39 user nova-compute[71354]:   </devices>
Apr 13 18:11:39 user nova-compute[71354]: </domain>
Apr 13 18:11:39 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1973954414',display_name='tempest-TestVolumeBootPattern-server-1973954414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1973954414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-puksh8gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:33Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=d350bf71-885d-4f3e-acdc-0136ab1469bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG os_vif [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff75bab4-c1, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff75bab4-c1, col_values=(('external_ids', {'iface-id': 'ff75bab4-c13b-465f-b2e8-ca4c8f860d5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9e:cc', 'vm-uuid': 'd350bf71-885d-4f3e-acdc-0136ab1469bd'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:39 user nova-compute[71354]: INFO os_vif [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1')
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:11:39 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] No VIF found with MAC fa:16:3e:b6:9e:cc, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:11:40 user nova-compute[71354]: INFO nova.compute.claims [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Claim successful on node user
Apr 13 18:11:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:11:40 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] No waiting events found dispatching network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:40 user nova-compute[71354]: WARNING nova.compute.manager [req-fca81c0e-8b7e-48e4-a43e-f611cb3b30ba req-4bffa41b-aac0-49ba-9ede-644740b46a22 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received unexpected event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance with vm_state building and task_state spawning.
Apr 13 18:11:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:40 user nova-compute[71354]: DEBUG nova.policy [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:11:41 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Creating image(s)
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "/opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "/opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.098s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk 1073741824" returned: 0 in 0.048s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.142s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Cannot resize image /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'migration_context' on Instance uuid c6f782ce-3912-43ff-b74c-dd645c3a4fe3 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Ensure instance console log exists: /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:41 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Successfully created port: bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Successfully updated port: bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquired lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-changed-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Refreshing instance network info cache due to event network-changed-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Acquiring lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.network.neutron [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Updating instance_info_cache with network_info: [{"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409502.9426682, d350bf71-885d-4f3e-acdc-0136ab1469bd => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] VM Resumed (Lifecycle Event)
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:11:42 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Instance spawned successfully.
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Releasing lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Instance network_info: |[{"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Acquired lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.network.neutron [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Refreshing network info cache for port bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Start _get_guest_xml network_info=[{"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:42 user nova-compute[71354]: DEBUG nova.compute.manager [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] No waiting events found dispatching network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:42 user nova-compute[71354]: WARNING nova.compute.manager [req-3ffeaa23-d112-4cee-9a36-fe38371f7199 req-fb7dd6be-6c0e-41ab-b3d3-e8747dcc097d service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received unexpected event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance with vm_state building and task_state spawning.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:43 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1211956599',display_name='tempest-VolumesActionsTest-instance-1211956599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1211956599',id=43,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-gqjyng5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:41Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=c6f782ce-3912-43ff-b74c-dd645c3a4fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f782ce-3912-43ff-b74c-dd645c3a4fe3 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:43 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409502.9446108, d350bf71-885d-4f3e-acdc-0136ab1469bd => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:43 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] VM Started (Lifecycle Event)
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:11:43 user nova-compute[71354]:   <uuid>c6f782ce-3912-43ff-b74c-dd645c3a4fe3</uuid>
Apr 13 18:11:43 user nova-compute[71354]:   <name>instance-0000002b</name>
Apr 13 18:11:43 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:11:43 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:11:43 user nova-compute[71354]:   <metadata>
Apr 13 18:11:43 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:11:43 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:name>tempest-VolumesActionsTest-instance-1211956599</nova:name>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:11:43</nova:creationTime>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:11:43 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:11:43 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:owner>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:user uuid="a8f752d2c4bf47c182cba7daeb460924">tempest-VolumesActionsTest-927910348-project-member</nova:user>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:project uuid="062033ffc6ac4a03964b7ed0bd1f2410">tempest-VolumesActionsTest-927910348</nova:project>
Apr 13 18:11:43 user nova-compute[71354]:       </nova:owner>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:11:43 user nova-compute[71354]:       <nova:ports>
Apr 13 18:11:43 user nova-compute[71354]:         <nova:port uuid="bffb8ceb-0ae2-4306-b370-e25f5ec3dd24">
Apr 13 18:11:43 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:11:43 user nova-compute[71354]:         </nova:port>
Apr 13 18:11:43 user nova-compute[71354]:       </nova:ports>
Apr 13 18:11:43 user nova-compute[71354]:     </nova:instance>
Apr 13 18:11:43 user nova-compute[71354]:   </metadata>
Apr 13 18:11:43 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:11:43 user nova-compute[71354]:     <system>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="serial">c6f782ce-3912-43ff-b74c-dd645c3a4fe3</entry>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="uuid">c6f782ce-3912-43ff-b74c-dd645c3a4fe3</entry>
Apr 13 18:11:43 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:11:43 user nova-compute[71354]:     </system>
Apr 13 18:11:43 user nova-compute[71354]:   </sysinfo>
Apr 13 18:11:43 user nova-compute[71354]:   <os>
Apr 13 18:11:43 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:11:43 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:11:43 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:11:43 user nova-compute[71354]:   </os>
Apr 13 18:11:43 user nova-compute[71354]:   <features>
Apr 13 18:11:43 user nova-compute[71354]:     <acpi/>
Apr 13 18:11:43 user nova-compute[71354]:     <apic/>
Apr 13 18:11:43 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:11:43 user nova-compute[71354]:   </features>
Apr 13 18:11:43 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:11:43 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:11:43 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:11:43 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:11:43 user nova-compute[71354]:   </clock>
Apr 13 18:11:43 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:11:43 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:11:43 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:11:43 user nova-compute[71354]:   </cpu>
Apr 13 18:11:43 user nova-compute[71354]:   <devices>
Apr 13 18:11:43 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:11:43 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:11:43 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk"/>
Apr 13 18:11:43 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:11:43 user nova-compute[71354]:     </disk>
Apr 13 18:11:43 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:11:43 user nova-compute[71354]:       <mac address="fa:16:3e:b9:37:6c"/>
Apr 13 18:11:43 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:43 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:11:43 user nova-compute[71354]:       <target dev="tapbffb8ceb-0a"/>
Apr 13 18:11:43 user nova-compute[71354]:     </interface>
Apr 13 18:11:43 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:11:43 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/console.log" append="off"/>
Apr 13 18:11:43 user nova-compute[71354]:     </serial>
Apr 13 18:11:43 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:11:43 user nova-compute[71354]:     <video>
Apr 13 18:11:43 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:11:43 user nova-compute[71354]:     </video>
Apr 13 18:11:43 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:11:43 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:11:43 user nova-compute[71354]:     </rng>
Apr 13 18:11:43 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:11:43 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:11:43 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:11:43 user nova-compute[71354]:     </memballoon>
Apr 13 18:11:43 user nova-compute[71354]:   </devices>
Apr 13 18:11:43 user nova-compute[71354]: </domain>
Apr 13 18:11:43 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1211956599',display_name='tempest-VolumesActionsTest-instance-1211956599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1211956599',id=43,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-gqjyng5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:11:41Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=c6f782ce-3912-43ff-b74c-dd645c3a4fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG os_vif [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbffb8ceb-0a, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbffb8ceb-0a, col_values=(('external_ids', {'iface-id': 'bffb8ceb-0ae2-4306-b370-e25f5ec3dd24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:6c', 'vm-uuid': 'c6f782ce-3912-43ff-b74c-dd645c3a4fe3'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:43 user nova-compute[71354]: INFO os_vif [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a')
Apr 13 18:11:43 user nova-compute[71354]: INFO nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:43 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] No VIF found with MAC fa:16:3e:b9:37:6c, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:11:43 user nova-compute[71354]: INFO nova.compute.manager [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Took 10.83 seconds to build instance.
Apr 13 18:11:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a531026a-e868-4066-bd3f-f955f28625bf tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.950s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.neutron [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Updated VIF entry in instance network info cache for port bffb8ceb-0ae2-4306-b370-e25f5ec3dd24. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG nova.network.neutron [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Updating instance_info_cache with network_info: [{"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:11:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1f24a7d7-f2a2-43aa-ba02-55306a91d2c2 req-64187fe4-7021-4761-8c68-10175e37ec04 service nova] Releasing lock "refresh_cache-c6f782ce-3912-43ff-b74c-dd645c3a4fe3" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] No waiting events found dispatching network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:44 user nova-compute[71354]: WARNING nova.compute.manager [req-492982e2-83b1-4127-bc53-22714e5daddd req-da9276d1-1f99-4427-b18a-553e8adb2a54 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received unexpected event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance with vm_state building and task_state spawning.
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] No waiting events found dispatching network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:11:46 user nova-compute[71354]: WARNING nova.compute.manager [req-c87d1d20-6c81-453f-a2f2-1109ad5a0bc7 req-3958ee41-77f4-4cc6-af43-29bc3337db44 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received unexpected event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance with vm_state building and task_state spawning.
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409506.8037546, c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] VM Resumed (Lifecycle Event)
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Instance spawned successfully.
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409506.8077443, c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] VM Started (Lifecycle Event)
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 13 18:11:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:11:46 user nova-compute[71354]: INFO nova.compute.manager [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Took 6.51 seconds to build instance.
Apr 13 18:11:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f4f72fde-306d-4d9c-a061-d655cb0be0f3 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.855s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:11:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:11:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attaching volume 628b9310-96f4-440c-9852-962d99e7a2bd to /dev/vdb
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.utils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66e1d5a-0d78-42dd-bb0c-5633c93714a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436619e-8c5c-48e6-a18a-f8aebde45052]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1228731f-6414-4689-acda-36a215b10f17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[df18f4ae-1a21-48b3-861d-46907b6da7bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:11:54 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:11:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5c242-4202-4692-9f0d-0097b0f83f5f]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG os_brick.utils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:11:54 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating existing volume attachment record: a7d6950c-23d5-47ad-b778-17c430bb8ef7 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:11:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvhRAMra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:11:59 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:11:59 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:11:59 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[771b07ff-514e-4eb6-9750-5bc580dac78d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:11:59 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[69efa8ce-77c5-4ef5-9118-25e57921767a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd] added
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8672ce7-dfac-4ac9-ae25-a6ed726c217b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed547b-f99f-4206-bfe4-d4410462a23f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvhRAMra {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvhRAMra" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1431f6c5-65b2-493b-89e9-487ed95d3977]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WvhRAMra'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9e17f9-5e87-4f9d-9087-c3e76008377a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[96de0456-51f3-4df3-a29d-b7ce8d4b2239]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a5e58-84e4-4a21-b512-ac0d0a6c2d60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260]
Apr 13 18:11:59 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260] successful.
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5324d919-d453-4c1d-9d08-c522cc65415d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f40c6e-70b0-4615-b215-e9cba98201a7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:11:59 user nova-compute[71354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)
Apr 13 18:11:59 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636ea3c-e202-41a3-b060-d4b2b1872393]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:11:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvhRAMra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26232333530343034', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232333530343034', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:12:00 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:12:00 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:12:00 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:12:00 user nova-compute[71354]:   <serial>628b9310-96f4-440c-9852-962d99e7a2bd</serial>
Apr 13 18:12:00 user nova-compute[71354]: </disk>
Apr 13 18:12:00 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:12:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No VIF found with MAC fa:16:3e:10:8f:65, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:12:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f91fec46-25ba-4a9f-8190-fc7ebe276991 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.405s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:02 user nova-compute[71354]: INFO nova.compute.manager [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Detaching volume 628b9310-96f4-440c-9852-962d99e7a2bd
Apr 13 18:12:02 user nova-compute[71354]: INFO nova.virt.block_device [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attempting to driver detach volume 628b9310-96f4-440c-9852-962d99e7a2bd from mountpoint /dev/vdb
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Attempting to detach device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:12:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:12:02 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:12:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:12:02 user nova-compute[71354]:   <serial>628b9310-96f4-440c-9852-962d99e7a2bd</serial>
Apr 13 18:12:02 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:12:02 user nova-compute[71354]: </disk>
Apr 13 18:12:02 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:12:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config.
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:12:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:12:02 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:12:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:12:02 user nova-compute[71354]:   <serial>628b9310-96f4-440c-9852-962d99e7a2bd</serial>
Apr 13 18:12:02 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:12:02 user nova-compute[71354]: </disk>
Apr 13 18:12:02 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409522.6981227, e65e349b-11fe-47a6-b47e-e965774b00a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:12:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config.
Apr 13 18:12:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvhRAMra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:12:02 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d52f07-829e-4490-8af2-1c294fd1b4a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:12:02 user nova-compute[71354]: No targets found.
Apr 13 18:12:02 user nova-compute[71354]: iSNS:
Apr 13 18:12:02 user nova-compute[71354]: No targets found.
Apr 13 18:12:02 user nova-compute[71354]: STATIC:
Apr 13 18:12:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:12:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:12:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:12:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd
Apr 13 18:12:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:12:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:12:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4
Apr 13 18:12:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:12:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:12:02 user nova-compute[71354]: FIRMWARE:
Apr 13 18:12:02 user nova-compute[71354]: No targets found.
Apr 13 18:12:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:12:02 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:12:02 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730a145-2413-4259-8969-ab2938e30dc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0442b-2bbf-4ccd-a155-57a831cf2ffa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:12:02 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:12:02 user nova-compute[71354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)
Apr 13 18:12:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:12:02 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:12:02 user nova-compute[71354]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd (non-flash)
Apr 13 18:12:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d440a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a150a8d3-28ee-44ad-b4b2-086e5392480f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[087aac58-7ddb-425b-9a1e-531620842c3e]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bdf64c-58fd-4f3c-b04c-eb7b632437d1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d086a85-3249-40d3-94dd-9df8d7d8073d]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6997e2d-73aa-4de5-abf3-b9aea5b2e617]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ef0b8-67c1-4dfb-b4c0-3429e4f4b472]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260]
Apr 13 18:12:02 user nova-compute[71354]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd, portal: 172.16.0.220,3260] successful.
Apr 13 18:12:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:12:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628b9310-96f4-440c-9852-962d99e7a2bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4113ceff-f7b2-47e7-83d5-f910bd98ca5e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== disconnect_volume: return (322ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG nova.objects.instance [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:12:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-bf7d1010-0a03-496c-9b5a-7974e209b078 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:06 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:07 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:12:07 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8140MB free_disk=26.16939926147461GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 265cff53-3a62-456a-92fd-98025a195518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance d350bf71-885d-4f3e-acdc-0136ab1469bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:12:07 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:08 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:12:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:17 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:12:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:12:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:12:17 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:12:18 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:25 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:30 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:12:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-changed-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG nova.compute.manager [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Refreshing instance network info cache due to event network-changed-1e990464-f0e7-451e-9833-ca1c228c892a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Acquiring lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Acquired lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:12:53 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Refreshing network info cache for port 1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:12:54 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updated VIF entry in instance network info cache for port 1e990464-f0e7-451e-9833-ca1c228c892a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:12:54 user nova-compute[71354]: DEBUG nova.network.neutron [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating instance_info_cache with network_info: [{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:12:54 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-b7e60a5c-3a4d-4620-ac96-37cd933cd661 req-0a892d2f-2a36-4d53-b292-609ecee190a4 service nova] Releasing lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:55 user nova-compute[71354]: INFO nova.compute.manager [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attaching volume 8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 to /dev/vdb
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c76412-b887-4f92-b040-710f3133ec8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c61446-3d4a-4bb1-b7f5-a041126b4aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b531cf2c-60b9-44ba-8ddc-e388dd8eb468]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b87c590-8afa-4dc4-925f-e138cf0d625f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:12:55 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461e0e3-8764-4a23-80f6-c8dddc0ea75b]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating existing volume attachment record: 5014489f-1d86-4232-bc1e-b2bc5e567523 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:55 user nova-compute[71354]: INFO nova.compute.manager [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Attaching volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 to /dev/vdb
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab39feb-941c-44af-895d-bb60e64f4a9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c271f581-1501-407e-b48a-9d9b27e2720b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbac516-c825-4ac9-bdc2-5b3acd32f61d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c827b79a-6843-42f7-b3ac-073465bdedfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:12:55 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:12:55 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1efa04-633e-4861-b3d5-81ff3acc68eb]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG os_brick.utils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:12:55 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating existing volume attachment record: 78fca915-a885-4afc-8dca-cefdff3d6504 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 265cff53-3a62-456a-92fd-98025a195518 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid d350bf71-885d-4f3e-acdc-0136ab1469bd {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid c6f782ce-3912-43ff-b74c-dd645c3a4fe3 {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "265cff53-3a62-456a-92fd-98025a195518" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "265cff53-3a62-456a-92fd-98025a195518" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:12:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQreAtHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:12:59 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:12:59 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:12:59 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:12:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feafa71-394c-4fe0-9428-1403b44e9b37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:12:59 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:12:59 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040b44c-bc34-4fc6-9c08-6562f4c7cfa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5] added
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d6815-a812-44f9-b086-c5a2cb6ced11]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54aa68-6ce0-4d64-b79f-5a51a66ee618]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQreAtHn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQreAtHn" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dab6b4-0be2-44c0-9fd6-be183256d54f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQreAtHn'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[681fe3d9-a36c-43f8-8d12-820e8022d870]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f39fb0-e3a3-4616-882e-24454afc9e56]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQtJMkNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:13:00 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c96452f-f171-417a-b35e-595068cb2bf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260]
Apr 13 18:13:00 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260] successful.
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[78262d84-2458-4520-ae47-181fcccd7fd4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf69b6-d56d-4854-9d83-3390c0ad928d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:00 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56bfbe-1593-4b0e-a553-bf2119ecb5e1]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:13:00 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQreAtHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23136653064373633', 'path': '/dev/sdd'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136653064373633', 'path': '/dev/sdd'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.082s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:13:01 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:13:01 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adb00df-dc82-441a-9c87-27a71150869c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:13:01 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:13:01 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:01 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:13:01 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:01 user nova-compute[71354]:   <serial>8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5</serial>
Apr 13 18:13:01 user nova-compute[71354]: </disk>
Apr 13 18:13:01 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d58121-2d77-485a-9488-7042348343e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8] added
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85762bb-919b-4c0d-8605-8c320169b678]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a071a-94fa-4781-b8d3-78b9811b6a9a]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQtJMkNP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQtJMkNP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4d846-69ee-462b-9dd6-560fcc229e11]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQtJMkNP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[77551734-d77f-4006-b0b8-2d9a75e49d77]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c69a392-e9d0-4ec4-a22d-872a22784162]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31fda49-9d9e-402d-a1db-f526b9103313]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260]
Apr 13 18:13:01 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260] successful.
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1038244-d452-4d8a-93df-9fafb9f10074]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[80048965-0459-4390-8c11-95cb77edf250]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35c94b-1f46-446e-b620-b2c4e46ece38]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No VIF found with MAC fa:16:3e:10:8f:65, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2c2191aa-802c-4683-b8e5-89b293964ccb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.514s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.013s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:01 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQtJMkNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== connect_volume: return (2374ms) {'type': 'block', 'scsi_wwn': '23061623064386662', 'path': '/dev/sde'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061623064386662', 'path': '/dev/sde'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:13:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:02 user nova-compute[71354]:   <source dev="/dev/sde"/>
Apr 13 18:13:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:02 user nova-compute[71354]:   <serial>09e00e3b-ca43-4ab9-83c9-c665144d06c8</serial>
Apr 13 18:13:02 user nova-compute[71354]: </disk>
Apr 13 18:13:02 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:13:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:b3:77:55, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2368711c-eacc-4756-9ee9-15502dec9801 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.477s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.342s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:03 user nova-compute[71354]: INFO nova.compute.manager [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Detaching volume 8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5
Apr 13 18:13:03 user nova-compute[71354]: INFO nova.virt.block_device [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attempting to driver detach volume 8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 from mountpoint /dev/vdb
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Attempting to detach device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:13:03 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:03 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:13:03 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:03 user nova-compute[71354]:   <serial>8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5</serial>
Apr 13 18:13:03 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:13:03 user nova-compute[71354]: </disk>
Apr 13 18:13:03 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:13:03 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config.
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:13:03 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:03 user nova-compute[71354]:   <source dev="/dev/sdd"/>
Apr 13 18:13:03 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:03 user nova-compute[71354]:   <serial>8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5</serial>
Apr 13 18:13:03 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:13:03 user nova-compute[71354]: </disk>
Apr 13 18:13:03 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409583.858281, e65e349b-11fe-47a6-b47e-e965774b00a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:13:03 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config.
Apr 13 18:13:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQreAtHn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:13:03 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c6749-47c8-4330-a3dc-dd5a13bbe663]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:13:03 user nova-compute[71354]: No targets found.
Apr 13 18:13:03 user nova-compute[71354]: iSNS:
Apr 13 18:13:03 user nova-compute[71354]: No targets found.
Apr 13 18:13:03 user nova-compute[71354]: STATIC:
Apr 13 18:13:03 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5
Apr 13 18:13:03 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:03 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:03 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:13:03 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:03 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:03 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4
Apr 13 18:13:03 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:03 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:03 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8
Apr 13 18:13:03 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:03 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:03 user nova-compute[71354]: FIRMWARE:
Apr 13 18:13:03 user nova-compute[71354]: No targets found.
Apr 13 18:13:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:13:03 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:13:03 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3613615a-f153-4285-aa9d-9e53c06b224a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3969b0a0-3eb7-4df5-a535-3c26d982d138]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50b4101e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5'): ({'sdd'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Removing single pathed devices sdd {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d5fb6a-6e2d-4c03-bf72-4f5567f4d8dd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ebf0f-79bd-4fa2-88ec-68d923005abb]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flushing IO for device /dev/sdd {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:13:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a9e38-0d95-4e88-a192-0be95b7148a0]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b3c50-849d-46dd-a3ea-21d964970829]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] SCSI volumes sdd have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa4ee1-6ff7-4dbb-b8d7-7e192c16d64e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c21bb-420c-42cc-bdab-76a42137374a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260]
Apr 13 18:13:04 user nova-compute[71354]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5, portal: 172.16.0.220,3260] successful.
Apr 13 18:13:04 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd71e7f-92aa-4ec6-b25c-2a8f1da4b5f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa71ac-6039-489b-b251-7511d1d18dca]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== disconnect_volume: return (304ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:04 user nova-compute[71354]: INFO nova.compute.manager [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Detaching volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8
Apr 13 18:13:04 user nova-compute[71354]: INFO nova.virt.block_device [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Attempting to driver detach volume 09e00e3b-ca43-4ab9-83c9-c665144d06c8 from mountpoint /dev/vdb
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Attempting to detach device vdb from instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:13:04 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:04 user nova-compute[71354]:   <source dev="/dev/sde"/>
Apr 13 18:13:04 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:04 user nova-compute[71354]:   <serial>09e00e3b-ca43-4ab9-83c9-c665144d06c8</serial>
Apr 13 18:13:04 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:13:04 user nova-compute[71354]: </disk>
Apr 13 18:13:04 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:13:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 from the persistent domain config.
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:13:04 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:13:04 user nova-compute[71354]:   <source dev="/dev/sde"/>
Apr 13 18:13:04 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:13:04 user nova-compute[71354]:   <serial>09e00e3b-ca43-4ab9-83c9-c665144d06c8</serial>
Apr 13 18:13:04 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:13:04 user nova-compute[71354]: </disk>
Apr 13 18:13:04 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:13:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7bf95ebc-c12b-4467-8ece-cd2aa6b58474 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409585.1311376, 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:13:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 from the live domain config.
Apr 13 18:13:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQtJMkNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:13:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[88267a2b-c204-446f-8b3e-390d4a3567c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:13:05 user nova-compute[71354]: No targets found.
Apr 13 18:13:05 user nova-compute[71354]: iSNS:
Apr 13 18:13:05 user nova-compute[71354]: No targets found.
Apr 13 18:13:05 user nova-compute[71354]: STATIC:
Apr 13 18:13:05 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:13:05 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:05 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:05 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4
Apr 13 18:13:05 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:05 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:05 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8
Apr 13 18:13:05 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:05 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:05 user nova-compute[71354]: FIRMWARE:
Apr 13 18:13:05 user nova-compute[71354]: No targets found.
Apr 13 18:13:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:13:05 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:13:05 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[500493f6-df22-4e46-ad1e-732aabbee4b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb80564-839f-4275-acc5-61d8ce3983b0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:05 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:05 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:05 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:05 user nova-compute[71354]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 (non-flash)
Apr 13 18:13:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50cc323130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8'): ({'sde'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Removing single pathed devices sde {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e02b70-8ab1-4a45-82fd-43db29b494f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b48b5-8c2a-4225-8a10-aafbc267740b]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flushing IO for device /dev/sde {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43c68d-5171-44e7-acd2-bda9eae0f143]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[20580c72-4256-4d71-913f-6f3a1f252f00]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] SCSI volumes sde have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[065231a6-2d31-4a93-855c-e55bcbe42206]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d185e3e-176e-495a-9099-008e452da7df]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260]
Apr 13 18:13:05 user nova-compute[71354]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8, portal: 172.16.0.220,3260] successful.
Apr 13 18:13:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e00e3b-ca43-4ab9-83c9-c665144d06c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77cc6da-3ad2-4cf3-81a8-52d46455976f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== disconnect_volume: return (284ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:13:06 user nova-compute[71354]: DEBUG nova.objects.instance [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-12ea5a54-5226-4d5a-9e1b-e58466e12e03 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.597s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:13:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:13:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:13:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8274MB free_disk=26.16777801513672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 265cff53-3a62-456a-92fd-98025a195518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance d350bf71-885d-4f3e-acdc-0136ab1469bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:13:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:13:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:19 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:13:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:13:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:13:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:13:19 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:13:20 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating instance_info_cache with network_info: [{"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-726eed4a-ac9c-4cef-aa8a-2600b26c1f81" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:13:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:13:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing instance network info cache due to event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Acquiring lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Acquired lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:13:23 user nova-compute[71354]: DEBUG nova.network.neutron [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updated VIF entry in instance network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-2545c162-8a99-43c6-8292-279f9efc2096 req-4eec9061-2e32-4999-92c5-7c4455717e19 service nova] Releasing lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.compute.manager [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing instance network info cache due to event network-changed-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Acquiring lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Acquired lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.network.neutron [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Refreshing network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:24 user nova-compute[71354]: INFO nova.compute.manager [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Terminating instance
Apr 13 18:13:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updated VIF entry in instance network info cache for port ff75bab4-c13b-465f-b2e8-ca4c8f860d5a. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [{"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-f9f0ecbe-d908-48cb-b424-38a17bcd8aef req-361bf7d4-259b-43e6-80f5-0c20c44b53ed service nova] Releasing lock "refresh_cache-d350bf71-885d-4f3e-acdc-0136ab1469bd" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:13:25 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Instance destroyed successfully.
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid d350bf71-885d-4f3e-acdc-0136ab1469bd {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1973954414',display_name='tempest-TestVolumeBootPattern-server-1973954414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1973954414',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:11:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-puksh8gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:11:43Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=d350bf71-885d-4f3e-acdc-0136ab1469bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "address": "fa:16:3e:b6:9e:cc", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff75bab4-c1", "ovs_interfaceid": "ff75bab4-c13b-465f-b2e8-ca4c8f860d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG os_vif [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff75bab4-c1, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:25 user nova-compute[71354]: INFO os_vif [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9e:cc,bridge_name='br-int',has_traffic_filtering=True,id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff75bab4-c1')
Apr 13 18:13:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmLtsyuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:13:25 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:13:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:13:25 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.047s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f91a55-554a-4170-a3a6-190eb7cf5c36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:13:26 user nova-compute[71354]: No targets found.
Apr 13 18:13:26 user nova-compute[71354]: iSNS:
Apr 13 18:13:26 user nova-compute[71354]: No targets found.
Apr 13 18:13:26 user nova-compute[71354]: STATIC:
Apr 13 18:13:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:13:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:26 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4
Apr 13 18:13:26 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:13:26 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:13:26 user nova-compute[71354]: FIRMWARE:
Apr 13 18:13:26 user nova-compute[71354]: No targets found.
Apr 13 18:13:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:13:26 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:13:26 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[24feb492-5bba-4a46-9e39-5ed273cd46e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a0ec5b-d28e-4121-be1a-7238d53c9590]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:26 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:13:26 user nova-compute[71354]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 (non-flash)
Apr 13 18:13:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d43570a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b85c7-ecd7-4939-abde-0f8feaf53b04]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073e5e9-3e1b-410b-a2cb-1d6db93de0e9]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[db195798-807c-4218-945a-63e4940716d1]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf37fc-62ae-4ed4-9740-cced6db93522]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[860aa368-8600-49a8-9874-b93186393d15]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa0f238-d012-45b6-bbdb-6165d01e9b2a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260]
Apr 13 18:13:26 user nova-compute[71354]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4, portal: 172.16.0.220,3260] successful.
Apr 13 18:13:26 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042b8df2-6b74-4c93-ba2b-2de2831316d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53ba9e-cff5-4a93-aabc-f8272e692f5b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (321ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:13:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Deleting instance files /opt/stack/data/nova/instances/d350bf71-885d-4f3e-acdc-0136ab1469bd_del
Apr 13 18:13:26 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Deletion of /opt/stack/data/nova/instances/d350bf71-885d-4f3e-acdc-0136ab1469bd_del complete
Apr 13 18:13:26 user nova-compute[71354]: INFO nova.compute.manager [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Took 1.45 seconds to destroy the instance on the hypervisor.
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:26 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Took 0.45 seconds to deallocate network for instance.
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-deleted-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:26 user nova-compute[71354]: INFO nova.compute.manager [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Neutron deleted interface ff75bab4-c13b-465f-b2e8-ca4c8f860d5a; detaching it from the instance and deleting it from the info cache
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.network.neutron [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-99479576-d078-44cc-9552-1d9cc38c653d req-433272be-9d84-4473-82bf-a2357b99c048 service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Detach interface failed, port_id=ff75bab4-c13b-465f-b2e8-ca4c8f860d5a, reason: Instance d350bf71-885d-4f3e-acdc-0136ab1469bd could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-unplugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] No waiting events found dispatching network-vif-unplugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-unplugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Acquiring lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] No waiting events found dispatching network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:26 user nova-compute[71354]: WARNING nova.compute.manager [req-197d5bec-9585-4bdd-b817-35d01e683dc7 req-2927873b-600a-47a4-bf58-56adb5a79e1c service nova] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Received unexpected event network-vif-plugged-ff75bab4-c13b-465f-b2e8-ca4c8f860d5a for instance with vm_state active and task_state deleting.
Apr 13 18:13:27 user nova-compute[71354]: INFO nova.compute.manager [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Took 0.81 seconds to detach 1 volumes for instance.
Apr 13 18:13:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:27 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:13:27 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:13:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:27 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance d350bf71-885d-4f3e-acdc-0136ab1469bd
Apr 13 18:13:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-07e20706-66cc-4c7e-847e-1a5881ef098c tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "d350bf71-885d-4f3e-acdc-0136ab1469bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.115s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:30 user nova-compute[71354]: INFO nova.compute.manager [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Terminating instance
Apr 13 18:13:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-unplugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] No waiting events found dispatching network-vif-unplugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.compute.manager [req-73e3ec40-faf4-48d5-8e18-0dd34425ef0d req-af016261-6e78-451a-a7bc-2ba08dd6c1d8 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-unplugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:13:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Instance destroyed successfully.
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.objects.instance [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'resources' on Instance uuid c6f782ce-3912-43ff-b74c-dd645c3a4fe3 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1211956599',display_name='tempest-VolumesActionsTest-instance-1211956599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1211956599',id=43,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-gqjyng5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:11:47Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=c6f782ce-3912-43ff-b74c-dd645c3a4fe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "address": "fa:16:3e:b9:37:6c", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb8ceb-0a", "ovs_interfaceid": "bffb8ceb-0ae2-4306-b370-e25f5ec3dd24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG os_vif [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbffb8ceb-0a, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:31 user nova-compute[71354]: INFO os_vif [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:6c,bridge_name='br-int',has_traffic_filtering=True,id=bffb8ceb-0ae2-4306-b370-e25f5ec3dd24,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb8ceb-0a')
Apr 13 18:13:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Deleting instance files /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3_del
Apr 13 18:13:31 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Deletion of /opt/stack/data/nova/instances/c6f782ce-3912-43ff-b74c-dd645c3a4fe3_del complete
Apr 13 18:13:31 user nova-compute[71354]: INFO nova.compute.manager [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 13 18:13:31 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:13:31 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:32 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Took 0.54 seconds to deallocate network for instance.
Apr 13 18:13:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG nova.compute.manager [req-ffb7f939-a018-4289-9156-1c0cf0fb789c req-ad08e67d-cb97-47a0-b6f0-986178ecf4ad service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-deleted-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:32 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Deleted allocations for instance c6f782ce-3912-43ff-b74c-dd645c3a4fe3
Apr 13 18:13:32 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-2b2f760e-a85f-4433-957f-3165f1d2143f tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Acquiring lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:33 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] Lock "c6f782ce-3912-43ff-b74c-dd645c3a4fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:33 user nova-compute[71354]: DEBUG nova.compute.manager [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] No waiting events found dispatching network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:33 user nova-compute[71354]: WARNING nova.compute.manager [req-8a4a9d25-275c-4582-8f19-9e073154938a req-35aa5b86-75de-48e3-9acf-d37f38d11258 service nova] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Received unexpected event network-vif-plugged-bffb8ceb-0ae2-4306-b370-e25f5ec3dd24 for instance with vm_state deleted and task_state None.
Apr 13 18:13:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:40 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409605.9336722, d350bf71-885d-4f3e-acdc-0136ab1469bd => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:13:40 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] VM Stopped (Lifecycle Event)
Apr 13 18:13:40 user nova-compute[71354]: DEBUG nova.compute.manager [None req-51d16e69-c5a6-43fa-a372-3e53fb7decba None None] [instance: d350bf71-885d-4f3e-acdc-0136ab1469bd] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:13:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:46 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409611.6570954, c6f782ce-3912-43ff-b74c-dd645c3a4fe3 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:13:46 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] VM Stopped (Lifecycle Event)
Apr 13 18:13:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-095b4d56-47e0-4858-9d67-12b042083ca5 None None] [instance: c6f782ce-3912-43ff-b74c-dd645c3a4fe3] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:13:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:55 user nova-compute[71354]: INFO nova.compute.manager [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Terminating instance
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-unplugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] No waiting events found dispatching network-vif-unplugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-428c2320-19a9-4a8b-addb-856066ea855d req-76a2bf1a-5216-42fa-9c0e-9574b37c145a service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-unplugged-1e990464-f0e7-451e-9833-ca1c228c892a for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:13:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Instance destroyed successfully.
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.objects.instance [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'resources' on Instance uuid 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-773936371',display_name='tempest-AttachVolumeNegativeTest-server-773936371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-773936371',id=41,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYxg2XyF7Adew+qh4/sZlHk9cfH5MC0/RGhywZ7WdUIWZ70Ee4BBYdRrK50BUnnUDE6EVAThjcmXg8SHgoZWM22UZrP+EyGmlzYkuUKI2lw7JBwCLxeWg66VmuLKH+WFw==',key_name='tempest-keypair-1291612920',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-12caypvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=726eed4a-ac9c-4cef-aa8a-2600b26c1f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "1e990464-f0e7-451e-9833-ca1c228c892a", "address": "fa:16:3e:b3:77:55", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e990464-f0", "ovs_interfaceid": "1e990464-f0e7-451e-9833-ca1c228c892a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG os_vif [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e990464-f0, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:13:55 user nova-compute[71354]: INFO os_vif [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:77:55,bridge_name='br-int',has_traffic_filtering=True,id=1e990464-f0e7-451e-9833-ca1c228c892a,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e990464-f0')
Apr 13 18:13:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Deleting instance files /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81_del
Apr 13 18:13:55 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Deletion of /opt/stack/data/nova/instances/726eed4a-ac9c-4cef-aa8a-2600b26c1f81_del complete
Apr 13 18:13:55 user nova-compute[71354]: INFO nova.compute.manager [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 18:13:55 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:13:55 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG nova.objects.instance [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:56 user nova-compute[71354]: INFO nova.compute.manager [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attaching volume e5bacdca-8985-4fbe-8acd-9956e367b90e to /dev/vdb
Apr 13 18:13:56 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:13:56 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Took 0.80 seconds to deallocate network for instance.
Apr 13 18:13:56 user nova-compute[71354]: DEBUG os_brick.utils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG nova.compute.manager [req-2eabf677-494f-474d-b5b0-46006f2647b8 req-82b464d5-dce9-41eb-b65a-b2c5602ceca3 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-deleted-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.253s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da7afa-58f0-4cb3-85c7-d247fb172ea5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:56 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f7622-fdcd-4acc-979d-a62bc61fe07d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09a265-8b7c-4457-ae4c-6942ad34e253]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b0074-5359-4c37-a17a-3e98fe32732d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:13:57 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe06c93-8196-42fd-8f45-86922811cd66]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG os_brick.utils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== get_connector_properties: return (367ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating existing volume attachment record: f3e0c184-afcd-4f27-951e-ee65ae2d33bb {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:57 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Deleted allocations for instance 726eed4a-ac9c-4cef-aa8a-2600b26c1f81
Apr 13 18:13:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Acquiring lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG nova.compute.manager [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] No waiting events found dispatching network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:13:57 user nova-compute[71354]: WARNING nova.compute.manager [req-661cf3cf-2f8d-4262-be4e-0ee3b9fba182 req-a8c93f80-f7e7-46cd-9225-6bdcc729fed2 service nova] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Received unexpected event network-vif-plugged-1e990464-f0e7-451e-9833-ca1c228c892a for instance with vm_state deleted and task_state None.
Apr 13 18:13:57 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-60fb929e-c4ab-46e2-b52e-ca7b38830bb0 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "726eed4a-ac9c-4cef-aa8a-2600b26c1f81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.369s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:13:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrdzhlPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:14:01 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:14:01 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:14:01 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea62ac-b4ba-4f34-8abb-15f3921cf420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:14:01 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec969bfe-8057-43be-a7e1-b87004730591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e] added
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3828d1ae-9571-4ad9-a206-06bdcef3694d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e79c65-988e-4cac-b53e-343c91dc246b]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrdzhlPH {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrdzhlPH" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2695602-06d2-4716-a682-ea7afaeb541f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrdzhlPH'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d413c0-17fb-40eb-9abe-8bd5eb888e67]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa71045-2a92-4b4b-a6da-faa37049ba02]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085d81e-331e-47da-88be-49931a623456]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260]
Apr 13 18:14:01 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260] successful.
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265dc6d-43ee-4c9d-92a3-b2e6dcabb7be]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e389e9-8111-448d-8bfa-d3ddccfefccb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:01 user nova-compute[71354]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:01 user nova-compute[71354]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)
Apr 13 18:14:01 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e256c42-ed9d-4842-8ce3-ae29077f691b]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:14:01 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrdzhlPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:14:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:14:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23066643537616631', 'path': '/dev/sdc'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:14:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066643537616631', 'path': '/dev/sdc'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:14:02 user nova-compute[71354]: DEBUG nova.objects.instance [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:14:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:14:02 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:14:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:14:02 user nova-compute[71354]:   <serial>e5bacdca-8985-4fbe-8acd-9956e367b90e</serial>
Apr 13 18:14:02 user nova-compute[71354]: </disk>
Apr 13 18:14:02 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:14:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:14:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:14:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] No VIF found with MAC fa:16:3e:10:8f:65, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:14:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-d2aa7834-392d-4919-a9c0-7b3791ba59bb tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.501s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:04 user nova-compute[71354]: INFO nova.compute.manager [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Detaching volume e5bacdca-8985-4fbe-8acd-9956e367b90e
Apr 13 18:14:04 user nova-compute[71354]: INFO nova.virt.block_device [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Attempting to driver detach volume e5bacdca-8985-4fbe-8acd-9956e367b90e from mountpoint /dev/vdb
Apr 13 18:14:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Attempting to detach device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:14:04 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:14:04 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:14:04 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:14:04 user nova-compute[71354]:   <serial>e5bacdca-8985-4fbe-8acd-9956e367b90e</serial>
Apr 13 18:14:04 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:14:04 user nova-compute[71354]: </disk>
Apr 13 18:14:04 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:14:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the persistent domain config.
Apr 13 18:14:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:14:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:14:04 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:14:04 user nova-compute[71354]:   <source dev="/dev/sdc"/>
Apr 13 18:14:04 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:14:04 user nova-compute[71354]:   <serial>e5bacdca-8985-4fbe-8acd-9956e367b90e</serial>
Apr 13 18:14:04 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:14:04 user nova-compute[71354]: </disk>
Apr 13 18:14:04 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409645.295482, e65e349b-11fe-47a6-b47e-e965774b00a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:14:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully detached device vdb from instance e65e349b-11fe-47a6-b47e-e965774b00a2 from the live domain config.
Apr 13 18:14:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrdzhlPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:14:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd2087-514f-439d-b3f9-a3d2d7b3548e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:14:05 user nova-compute[71354]: No targets found.
Apr 13 18:14:05 user nova-compute[71354]: iSNS:
Apr 13 18:14:05 user nova-compute[71354]: No targets found.
Apr 13 18:14:05 user nova-compute[71354]: STATIC:
Apr 13 18:14:05 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:14:05 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:14:05 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:14:05 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e
Apr 13 18:14:05 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:14:05 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:14:05 user nova-compute[71354]: FIRMWARE:
Apr 13 18:14:05 user nova-compute[71354]: No targets found.
Apr 13 18:14:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:14:05 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:14:05 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6286b3-4712-44e4-82fa-c02770ee1613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc815d37-eb9b-43d8-94a4-bd20227228a2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:05 user nova-compute[71354]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)
Apr 13 18:14:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:05 user nova-compute[71354]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e (non-flash)
Apr 13 18:14:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d4448d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e'): ({'sdc'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Removing single pathed devices sdc {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c426f95a-d50e-4839-9645-c4d5ae5daefd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c425d58-429c-4fdf-a42a-01445587ae90]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Flushing IO for device /dev/sdc {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e642dacb-5551-4557-b791-9ec787b59104]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dccaec-2a22-4a4f-82f8-cb4c3e6230bd]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] SCSI volumes sdc have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b2895-7a83-4a50-bec8-4993d4713cf9]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[16384c62-fc34-4bb6-a588-fc14c867fbb2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260]
Apr 13 18:14:05 user nova-compute[71354]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e, portal: 172.16.0.220,3260] successful.
Apr 13 18:14:05 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bacdca-8985-4fbe-8acd-9956e367b90e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9fb6c-e2b1-4a97-baf6-dd23906b7209]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] <== disconnect_volume: return (275ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:14:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:06 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'flavor' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b2621201-14f4-4e33-a587-3cdafab8da37 tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.559s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:08 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71354) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:14:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:09 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=26.20439910888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 265cff53-3a62-456a-92fd-98025a195518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:14:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:10 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409635.8039956, 726eed4a-ac9c-4cef-aa8a-2600b26c1f81 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:10 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] VM Stopped (Lifecycle Event)
Apr 13 18:14:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-fb442433-8224-40ee-8b7f-fe4e0dde1633 None None] [instance: 726eed4a-ac9c-4cef-aa8a-2600b26c1f81] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing instance network info cache due to event network-changed-eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Acquiring lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Acquired lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.network.neutron [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Refreshing network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:21 user nova-compute[71354]: INFO nova.compute.manager [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Terminating instance
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Skipping network cache update for instance because it is being deleted. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:14:21 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] Instance destroyed successfully.
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lazy-loading 'resources' on Instance uuid 265cff53-3a62-456a-92fd-98025a195518 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-15971703',display_name='tempest-TestVolumeBootPattern-server-15971703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-15971703',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqqXbbWson2Yr1gKTtsyyG5n5dgRD+0B2+BGPBKnlxd/pkk2JaUn7f79X/Q2AAz1oZD/MNB6COAQnvsm6Bah+gtCat0AB9aYkyEHbejb3S9Al2HNUPlXLDtOt3V8PZVw==',key_name='tempest-TestVolumeBootPattern-1422503133',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25f789d52faa469c802d7c1281ed8c82',ramdisk_id='',reservation_id='r-8ll8vb0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1858052268',owner_user_name='tempest-TestVolumeBootPattern-1858052268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:09:43Z,user_data=None,user_id='1cd4d2b21dda452dab66c1973c3beec1',uuid=265cff53-3a62-456a-92fd-98025a195518,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converting VIF {"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_vif [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb4d0c83-d6, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:22 user nova-compute[71354]: INFO os_vif [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:90:00,bridge_name='br-int',has_traffic_filtering=True,id=eb4d0c83-d6e6-424e-a956-d52ece4d3228,network=Network(d901aa48-1af6-4ded-9c70-e270315524cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4d0c83-d6')
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pstboqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:14:22 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b5bac-f56e-40d7-ac64-d5b20a9d6c7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:14:22 user nova-compute[71354]: No targets found.
Apr 13 18:14:22 user nova-compute[71354]: iSNS:
Apr 13 18:14:22 user nova-compute[71354]: No targets found.
Apr 13 18:14:22 user nova-compute[71354]: STATIC:
Apr 13 18:14:22 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce
Apr 13 18:14:22 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:14:22 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:14:22 user nova-compute[71354]: FIRMWARE:
Apr 13 18:14:22 user nova-compute[71354]: No targets found.
Apr 13 18:14:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:14:22 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:14:22 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e9cc2-1d1a-4e09-ad1f-3002a0b8fc4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updated VIF entry in instance network info cache for port eb4d0c83-d6e6-424e-a956-d52ece4d3228. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.network.neutron [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [{"id": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "address": "fa:16:3e:9b:90:00", "network": {"id": "d901aa48-1af6-4ded-9c70-e270315524cc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-416641387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25f789d52faa469c802d7c1281ed8c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4d0c83-d6", "ovs_interfaceid": "eb4d0c83-d6e6-424e-a956-d52ece4d3228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cefa94-221e-4436-b56e-c996b1b11b9b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce (non-flash)
Apr 13 18:14:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50b4168dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe5-cffc-4669-ac54-52d57e4a5714 req-09d863a7-a68a-4ea0-9036-1bfa6d51e5e5 service nova] Releasing lock "refresh_cache-265cff53-3a62-456a-92fd-98025a195518" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a807690e-8c32-407f-885b-fd832d1408a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd2f1c-71a8-4039-9c21-f42f10ae9cf6]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[985f94f8-1e49-41e1-846c-cb06ac1a1670]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd81c0-38de-4731-ba56-a3b99b68de3e]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[75806e3f-16b3-494e-b196-eb2f95d2b69e]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4612110c-4134-4c29-a287-c53f5b4a477f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260]
Apr 13 18:14:22 user nova-compute[71354]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce, portal: 172.16.0.220,3260] successful.
Apr 13 18:14:22 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:329d61b0-027c-48c2-a0a1-0a93645302ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5d7b83-d3c7-4283-b948-564ad428b777]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] <== disconnect_volume: return (320ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:14:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Deleting instance files /opt/stack/data/nova/instances/265cff53-3a62-456a-92fd-98025a195518_del
Apr 13 18:14:22 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Deletion of /opt/stack/data/nova/instances/265cff53-3a62-456a-92fd-98025a195518_del complete
Apr 13 18:14:22 user nova-compute[71354]: INFO nova.compute.manager [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:22 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:14:22 user nova-compute[71354]: INFO nova.compute.claims [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Claim successful on node user
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:14:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.policy [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8f752d2c4bf47c182cba7daeb460924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062033ffc6ac4a03964b7ed0bd1f2410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:14:23 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Creating image(s)
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "/opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "/opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-unplugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] No waiting events found dispatching network-vif-unplugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-unplugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Acquiring lock "265cff53-3a62-456a-92fd-98025a195518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] Lock "265cff53-3a62-456a-92fd-98025a195518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] No waiting events found dispatching network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:23 user nova-compute[71354]: WARNING nova.compute.manager [req-4419b995-6ce4-4124-935f-e6a3030f95ed req-91ac2afb-4e2a-481c-928d-0bdfceb39449 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received unexpected event network-vif-plugged-eb4d0c83-d6e6-424e-a956-d52ece4d3228 for instance with vm_state active and task_state deleting.
Apr 13 18:14:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:23 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] Took 0.73 seconds to deallocate network for instance.
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.157s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk 1073741824" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Cannot resize image /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'migration_context' on Instance uuid b2a75c59-c54c-49ea-908f-ff7856befac7 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Ensure instance console log exists: /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Successfully created port: c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:14:24 user nova-compute[71354]: INFO nova.compute.manager [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] [instance: 265cff53-3a62-456a-92fd-98025a195518] Took 0.99 seconds to detach 1 volumes for instance.
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Successfully updated port: c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquired lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:24 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Deleted allocations for instance 265cff53-3a62-456a-92fd-98025a195518
Apr 13 18:14:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:14:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0c552e1-e4a4-43b5-98f0-77ba85eeb940 tempest-TestVolumeBootPattern-1858052268 tempest-TestVolumeBootPattern-1858052268-project-member] Lock "265cff53-3a62-456a-92fd-98025a195518" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.346s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updating instance_info_cache with network_info: [{"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Releasing lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Instance network_info: |[{"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Start _get_guest_xml network_info=[{"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:14:25 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:25 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1233881546',display_name='tempest-VolumesActionsTest-instance-1233881546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1233881546',id=44,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-tx6roo2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:14:23Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=b2a75c59-c54c-49ea-908f-ff7856befac7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'pci_devices' on Instance uuid b2a75c59-c54c-49ea-908f-ff7856befac7 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:14:25 user nova-compute[71354]:   <uuid>b2a75c59-c54c-49ea-908f-ff7856befac7</uuid>
Apr 13 18:14:25 user nova-compute[71354]:   <name>instance-0000002c</name>
Apr 13 18:14:25 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:14:25 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:14:25 user nova-compute[71354]:   <metadata>
Apr 13 18:14:25 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:14:25 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:name>tempest-VolumesActionsTest-instance-1233881546</nova:name>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:14:25</nova:creationTime>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:14:25 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:14:25 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:owner>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:user uuid="a8f752d2c4bf47c182cba7daeb460924">tempest-VolumesActionsTest-927910348-project-member</nova:user>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:project uuid="062033ffc6ac4a03964b7ed0bd1f2410">tempest-VolumesActionsTest-927910348</nova:project>
Apr 13 18:14:25 user nova-compute[71354]:       </nova:owner>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:14:25 user nova-compute[71354]:       <nova:ports>
Apr 13 18:14:25 user nova-compute[71354]:         <nova:port uuid="c98bd656-3b1a-4b2d-adb9-026b171ef063">
Apr 13 18:14:25 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:14:25 user nova-compute[71354]:         </nova:port>
Apr 13 18:14:25 user nova-compute[71354]:       </nova:ports>
Apr 13 18:14:25 user nova-compute[71354]:     </nova:instance>
Apr 13 18:14:25 user nova-compute[71354]:   </metadata>
Apr 13 18:14:25 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:14:25 user nova-compute[71354]:     <system>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="serial">b2a75c59-c54c-49ea-908f-ff7856befac7</entry>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="uuid">b2a75c59-c54c-49ea-908f-ff7856befac7</entry>
Apr 13 18:14:25 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:14:25 user nova-compute[71354]:     </system>
Apr 13 18:14:25 user nova-compute[71354]:   </sysinfo>
Apr 13 18:14:25 user nova-compute[71354]:   <os>
Apr 13 18:14:25 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:14:25 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:14:25 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:14:25 user nova-compute[71354]:   </os>
Apr 13 18:14:25 user nova-compute[71354]:   <features>
Apr 13 18:14:25 user nova-compute[71354]:     <acpi/>
Apr 13 18:14:25 user nova-compute[71354]:     <apic/>
Apr 13 18:14:25 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:14:25 user nova-compute[71354]:   </features>
Apr 13 18:14:25 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:14:25 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:14:25 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:14:25 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:14:25 user nova-compute[71354]:   </clock>
Apr 13 18:14:25 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:14:25 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:14:25 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:14:25 user nova-compute[71354]:   </cpu>
Apr 13 18:14:25 user nova-compute[71354]:   <devices>
Apr 13 18:14:25 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:14:25 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:14:25 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk"/>
Apr 13 18:14:25 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:14:25 user nova-compute[71354]:     </disk>
Apr 13 18:14:25 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:14:25 user nova-compute[71354]:       <mac address="fa:16:3e:af:59:5a"/>
Apr 13 18:14:25 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:14:25 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:14:25 user nova-compute[71354]:       <target dev="tapc98bd656-3b"/>
Apr 13 18:14:25 user nova-compute[71354]:     </interface>
Apr 13 18:14:25 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:14:25 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/console.log" append="off"/>
Apr 13 18:14:25 user nova-compute[71354]:     </serial>
Apr 13 18:14:25 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:14:25 user nova-compute[71354]:     <video>
Apr 13 18:14:25 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:14:25 user nova-compute[71354]:     </video>
Apr 13 18:14:25 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:14:25 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:14:25 user nova-compute[71354]:     </rng>
Apr 13 18:14:25 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:14:25 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:14:25 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:14:25 user nova-compute[71354]:     </memballoon>
Apr 13 18:14:25 user nova-compute[71354]:   </devices>
Apr 13 18:14:25 user nova-compute[71354]: </domain>
Apr 13 18:14:25 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1233881546',display_name='tempest-VolumesActionsTest-instance-1233881546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1233881546',id=44,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-tx6roo2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:14:23Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=b2a75c59-c54c-49ea-908f-ff7856befac7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG os_vif [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc98bd656-3b, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc98bd656-3b, col_values=(('external_ids', {'iface-id': 'c98bd656-3b1a-4b2d-adb9-026b171ef063', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:59:5a', 'vm-uuid': 'b2a75c59-c54c-49ea-908f-ff7856befac7'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:25 user nova-compute[71354]: INFO os_vif [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b')
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] No VIF found with MAC fa:16:3e:af:59:5a, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: 265cff53-3a62-456a-92fd-98025a195518] Received event network-vif-deleted-eb4d0c83-d6e6-424e-a956-d52ece4d3228 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-changed-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.compute.manager [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Refreshing instance network info cache due to event network-changed-c98bd656-3b1a-4b2d-adb9-026b171ef063. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Acquiring lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Acquired lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Refreshing network info cache for port c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updated VIF entry in instance network info cache for port c98bd656-3b1a-4b2d-adb9-026b171ef063. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG nova.network.neutron [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updating instance_info_cache with network_info: [{"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-38d2cba4-bd2b-48d2-8208-dae0bff33622 req-cd484e90-2ebd-466d-9334-9deaf723c5e8 service nova] Releasing lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:26 user nova-compute[71354]: DEBUG nova.compute.manager [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:26 user nova-compute[71354]: WARNING nova.compute.manager [req-9296e498-1d95-4717-a8d8-1bf0a6cf2c3d req-f191f967-8ebb-4cb3-9176-bb89fb505838 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state building and task_state spawning.
Apr 13 18:14:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409668.5967994, b2a75c59-c54c-49ea-908f-ff7856befac7 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] VM Resumed (Lifecycle Event)
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Instance spawned successfully.
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409668.598055, b2a75c59-c54c-49ea-908f-ff7856befac7 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] VM Started (Lifecycle Event)
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:28 user nova-compute[71354]: WARNING nova.compute.manager [req-732f1c39-36a6-4fb2-81e7-9b46765a1ad8 req-83a1a3b4-df3f-4eb3-ad1c-a2fdd2edfebf service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state building and task_state spawning.
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Took 5.37 seconds to spawn the instance on the hypervisor.
Apr 13 18:14:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:28 user nova-compute[71354]: INFO nova.compute.manager [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Took 5.91 seconds to build instance.
Apr 13 18:14:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-b1a1d437-e33b-49ff-8c3e-4e41a242cb00 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.005s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:14:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:37 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409662.2676203, 265cff53-3a62-456a-92fd-98025a195518 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:37 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 265cff53-3a62-456a-92fd-98025a195518] VM Stopped (Lifecycle Event)
Apr 13 18:14:37 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ff9332d4-ae55-4413-9011-03e297ec26a0 None None] [instance: 265cff53-3a62-456a-92fd-98025a195518] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:14:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:14:48 user nova-compute[71354]: INFO nova.compute.claims [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Claim successful on node user
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:14:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.policy [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ac81be2a2db40b2acbae911db8086ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bfb2b952aa4fd8a66d4eb5aa052e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:14:48 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Creating image(s)
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "/opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "/opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:48 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk 1073741824" returned: 0 in 0.065s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Cannot resize image /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'migration_context' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Ensure instance console log exists: /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:49 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Successfully created port: 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Successfully updated port: 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquired lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-changed-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG nova.compute.manager [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Refreshing instance network info cache due to event network-changed-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Acquiring lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:14:50 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.neutron [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Releasing lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Instance network_info: |[{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Acquired lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Refreshing network info cache for port 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Start _get_guest_xml network_info=[{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:14:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:51 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854731271',display_name='tempest-AttachVolumeNegativeTest-server-1854731271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854731271',id=45,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHNju1AA9B90vrvDFy8kmD5AJdCh3GaYjia8Kjy/e5MlIDSLb16RR+R/NvEZ/dLTX9d+CC0afomz07XWjbWwI1ou51yNrVwg6CdbDS3UkcALU2sN/6oDYbdwbwbzb7U3A==',key_name='tempest-keypair-1180586501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-59e754e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=795e0737-96c6-4fea-8806-acab63dca5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'pci_devices' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:14:51 user nova-compute[71354]:   <uuid>795e0737-96c6-4fea-8806-acab63dca5c1</uuid>
Apr 13 18:14:51 user nova-compute[71354]:   <name>instance-0000002d</name>
Apr 13 18:14:51 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:14:51 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:14:51 user nova-compute[71354]:   <metadata>
Apr 13 18:14:51 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:14:51 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1854731271</nova:name>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:14:51</nova:creationTime>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:14:51 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:14:51 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:owner>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:user uuid="0ac81be2a2db40b2acbae911db8086ca">tempest-AttachVolumeNegativeTest-1374126190-project-member</nova:user>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:project uuid="c5bfb2b952aa4fd8a66d4eb5aa052e97">tempest-AttachVolumeNegativeTest-1374126190</nova:project>
Apr 13 18:14:51 user nova-compute[71354]:       </nova:owner>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:14:51 user nova-compute[71354]:       <nova:ports>
Apr 13 18:14:51 user nova-compute[71354]:         <nova:port uuid="9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c">
Apr 13 18:14:51 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 18:14:51 user nova-compute[71354]:         </nova:port>
Apr 13 18:14:51 user nova-compute[71354]:       </nova:ports>
Apr 13 18:14:51 user nova-compute[71354]:     </nova:instance>
Apr 13 18:14:51 user nova-compute[71354]:   </metadata>
Apr 13 18:14:51 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:14:51 user nova-compute[71354]:     <system>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="serial">795e0737-96c6-4fea-8806-acab63dca5c1</entry>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="uuid">795e0737-96c6-4fea-8806-acab63dca5c1</entry>
Apr 13 18:14:51 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:14:51 user nova-compute[71354]:     </system>
Apr 13 18:14:51 user nova-compute[71354]:   </sysinfo>
Apr 13 18:14:51 user nova-compute[71354]:   <os>
Apr 13 18:14:51 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:14:51 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:14:51 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:14:51 user nova-compute[71354]:   </os>
Apr 13 18:14:51 user nova-compute[71354]:   <features>
Apr 13 18:14:51 user nova-compute[71354]:     <acpi/>
Apr 13 18:14:51 user nova-compute[71354]:     <apic/>
Apr 13 18:14:51 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:14:51 user nova-compute[71354]:   </features>
Apr 13 18:14:51 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:14:51 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:14:51 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:14:51 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:14:51 user nova-compute[71354]:   </clock>
Apr 13 18:14:51 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:14:51 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:14:51 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:14:51 user nova-compute[71354]:   </cpu>
Apr 13 18:14:51 user nova-compute[71354]:   <devices>
Apr 13 18:14:51 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:14:51 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:14:51 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk"/>
Apr 13 18:14:51 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:14:51 user nova-compute[71354]:     </disk>
Apr 13 18:14:51 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:14:51 user nova-compute[71354]:       <mac address="fa:16:3e:27:8f:e3"/>
Apr 13 18:14:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:14:51 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:14:51 user nova-compute[71354]:       <target dev="tap9ac6b872-44"/>
Apr 13 18:14:51 user nova-compute[71354]:     </interface>
Apr 13 18:14:51 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:14:51 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/console.log" append="off"/>
Apr 13 18:14:51 user nova-compute[71354]:     </serial>
Apr 13 18:14:51 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:14:51 user nova-compute[71354]:     <video>
Apr 13 18:14:51 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:14:51 user nova-compute[71354]:     </video>
Apr 13 18:14:51 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:14:51 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:14:51 user nova-compute[71354]:     </rng>
Apr 13 18:14:51 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:14:51 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:14:51 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:14:51 user nova-compute[71354]:     </memballoon>
Apr 13 18:14:51 user nova-compute[71354]:   </devices>
Apr 13 18:14:51 user nova-compute[71354]: </domain>
Apr 13 18:14:51 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854731271',display_name='tempest-AttachVolumeNegativeTest-server-1854731271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854731271',id=45,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHNju1AA9B90vrvDFy8kmD5AJdCh3GaYjia8Kjy/e5MlIDSLb16RR+R/NvEZ/dLTX9d+CC0afomz07XWjbWwI1ou51yNrVwg6CdbDS3UkcALU2sN/6oDYbdwbwbzb7U3A==',key_name='tempest-keypair-1180586501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-59e754e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=795e0737-96c6-4fea-8806-acab63dca5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG os_vif [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ac6b872-44, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ac6b872-44, col_values=(('external_ids', {'iface-id': '9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:8f:e3', 'vm-uuid': '795e0737-96c6-4fea-8806-acab63dca5c1'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:51 user nova-compute[71354]: INFO os_vif [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44')
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:27:8f:e3, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updated VIF entry in instance network info cache for port 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG nova.network.neutron [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:14:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-1ed2de02-7a76-4e15-a22c-5e1e09638c60 req-1ef228b2-b2a0-4de5-85a6-0d08dcded287 service nova] Releasing lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:52 user nova-compute[71354]: DEBUG nova.compute.manager [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] No waiting events found dispatching network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:52 user nova-compute[71354]: WARNING nova.compute.manager [req-db3a410f-1f9e-4989-8d8a-3cd4d88a3ed1 req-3fc6f753-700c-4885-b374-3f5185b1ea62 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received unexpected event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance with vm_state building and task_state spawning.
Apr 13 18:14:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409694.5488205, 795e0737-96c6-4fea-8806-acab63dca5c1 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:54 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] VM Resumed (Lifecycle Event)
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:14:54 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Instance spawned successfully.
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:54 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:14:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409694.549877, 795e0737-96c6-4fea-8806-acab63dca5c1 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:14:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] VM Started (Lifecycle Event)
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:14:55 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.compute.manager [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] No waiting events found dispatching network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:14:55 user nova-compute[71354]: WARNING nova.compute.manager [req-bb3ced36-9d89-49fa-a596-e21e6c0fe119 req-e33404c7-32f0-4c17-8d65-255841df0aee service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received unexpected event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance with vm_state building and task_state spawning.
Apr 13 18:14:55 user nova-compute[71354]: INFO nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 13 18:14:55 user nova-compute[71354]: DEBUG nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:14:55 user nova-compute[71354]: INFO nova.compute.manager [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Took 6.52 seconds to build instance.
Apr 13 18:14:55 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ca23e36a-76e6-40d8-bb32-6756cbe83969 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.657s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:14:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:14:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:02 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:15:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:15:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing instance network info cache due to event network-changed-06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Acquiring lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Acquired lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG nova.network.neutron [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Refreshing network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG nova.network.neutron [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updated VIF entry in instance network info cache for port 06a96589-5953-47a0-8e30-efd8d4dff9f3. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG nova.network.neutron [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [{"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:15:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-6d79e777-c76e-4e69-9b12-d8111ddc908a req-4ddcad42-b87b-4cae-9359-449b5a64bec5 service nova] Releasing lock "refresh_cache-e65e349b-11fe-47a6-b47e-e965774b00a2" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:10 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:11 user nova-compute[71354]: INFO nova.compute.manager [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Terminating instance
Apr 13 18:15:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:15:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-unplugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] No waiting events found dispatching network-vif-unplugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.manager [req-fcf72fc5-3dfe-4219-8333-4f57bf8e711b req-6a7b8584-b3e7-4e33-90f9-76765b386097 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-unplugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:15:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Instance destroyed successfully.
Apr 13 18:15:12 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:15:12 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=26.14710235595703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.objects.instance [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lazy-loading 'resources' on Instance uuid e65e349b-11fe-47a6-b47e-e965774b00a2 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591177314',display_name='tempest-SnapshotDataIntegrityTests-server-591177314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591177314',id=39,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdDeKUtzSJspI72lbnknMzrtvKpB0VydInTJsCsqet7lYHxrl/btstctTwKJWV85y67b/TCTdh6M3eDr2mWkPKceN9b0PJAktNVaLOCELxlNW6m4q+2Lex6DrRkDZPllg==',key_name='tempest-SnapshotDataIntegrityTests-70279965',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d0b8c72627d48718f4d6657f0c220a3',ramdisk_id='',reservation_id='r-0so9yfjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1434998905',owner_user_name='tempest-SnapshotDataIntegrityTests-1434998905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:08:55Z,user_data=None,user_id='414376a2c1204907aadfc83bbe3348e7',uuid=e65e349b-11fe-47a6-b47e-e965774b00a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converting VIF {"id": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "address": "fa:16:3e:10:8f:65", "network": {"id": "aa3bc514-e932-4cb2-bead-6d300a332487", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1308251959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0b8c72627d48718f4d6657f0c220a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a96589-59", "ovs_interfaceid": "06a96589-5953-47a0-8e30-efd8d4dff9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG os_vif [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06a96589-59, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:15:12 user nova-compute[71354]: INFO os_vif [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:8f:65,bridge_name='br-int',has_traffic_filtering=True,id=06a96589-5953-47a0-8e30-efd8d4dff9f3,network=Network(aa3bc514-e932-4cb2-bead-6d300a332487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a96589-59')
Apr 13 18:15:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Deleting instance files /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2_del
Apr 13 18:15:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Deletion of /opt/stack/data/nova/instances/e65e349b-11fe-47a6-b47e-e965774b00a2_del complete
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance e65e349b-11fe-47a6-b47e-e965774b00a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b2a75c59-c54c-49ea-908f-ff7856befac7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 795e0737-96c6-4fea-8806-acab63dca5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:15:12 user nova-compute[71354]: INFO nova.compute.manager [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:15:13 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Took 0.48 seconds to deallocate network for instance.
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-deleted-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:15:13 user nova-compute[71354]: INFO nova.compute.manager [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Neutron deleted interface 06a96589-5953-47a0-8e30-efd8d4dff9f3; detaching it from the instance and deleting it from the info cache
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.network.neutron [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-e441e1d4-26a6-4703-9fed-48b81f090a73 req-217b9850-1738-445f-9752-dd6a9f0457a7 service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Detach interface failed, port_id=06a96589-5953-47a0-8e30-efd8d4dff9f3, reason: Instance e65e349b-11fe-47a6-b47e-e965774b00a2 could not be found. {{(pid=71354) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:13 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Deleted allocations for instance e65e349b-11fe-47a6-b47e-e965774b00a2
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-69efeb23-9c3d-4bc9-81a4-3665752c89dc tempest-SnapshotDataIntegrityTests-1434998905 tempest-SnapshotDataIntegrityTests-1434998905-project-member] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:15:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Acquiring lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:15:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:15:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] Lock "e65e349b-11fe-47a6-b47e-e965774b00a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:15:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] No waiting events found dispatching network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:15:14 user nova-compute[71354]: WARNING nova.compute.manager [req-45b8e05a-59ce-40b3-a481-5a46e6f24438 req-accc8369-e73b-451c-8022-bb264390a88e service nova] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Received unexpected event network-vif-plugged-06a96589-5953-47a0-8e30-efd8d4dff9f3 for instance with vm_state deleted and task_state None.
Apr 13 18:15:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:17 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid b2a75c59-c54c-49ea-908f-ff7856befac7 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:15:22 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updating instance_info_cache with network_info: [{"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:15:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-b2a75c59-c54c-49ea-908f-ff7856befac7" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:15:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:15:27 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409712.2327273, e65e349b-11fe-47a6-b47e-e965774b00a2 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:15:27 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] VM Stopped (Lifecycle Event)
Apr 13 18:15:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-646176ca-8295-482d-9447-a6af0c054ebc None None] [instance: e65e349b-11fe-47a6-b47e-e965774b00a2] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:15:27 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:15:37 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:47 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:52 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:15:57 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:02 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:04 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:06 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:16:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:12 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:16:13 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=26.155914306640625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:13 user nova-compute[71354]: INFO nova.compute.manager [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Terminating instance
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance b2a75c59-c54c-49ea-908f-ff7856befac7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 795e0737-96c6-4fea-8806-acab63dca5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:13 user nova-compute[71354]: DEBUG nova.compute.manager [req-a60c31e8-15ea-4879-b7e1-e554c32a54e5 req-f443de5e-2b05-4a64-ad78-9ee29233876f service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Instance destroyed successfully.
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lazy-loading 'resources' on Instance uuid b2a75c59-c54c-49ea-908f-ff7856befac7 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1233881546',display_name='tempest-VolumesActionsTest-instance-1233881546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1233881546',id=44,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='062033ffc6ac4a03964b7ed0bd1f2410',ramdisk_id='',reservation_id='r-tx6roo2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-927910348',owner_user_name='tempest-VolumesActionsTest-927910348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:14:29Z,user_data=None,user_id='a8f752d2c4bf47c182cba7daeb460924',uuid=b2a75c59-c54c-49ea-908f-ff7856befac7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converting VIF {"id": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "address": "fa:16:3e:af:59:5a", "network": {"id": "8c0bb9a4-c569-427c-b647-0edba62c1127", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308375511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "062033ffc6ac4a03964b7ed0bd1f2410", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc98bd656-3b", "ovs_interfaceid": "c98bd656-3b1a-4b2d-adb9-026b171ef063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG os_vif [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc98bd656-3b, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:14 user nova-compute[71354]: INFO os_vif [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:59:5a,bridge_name='br-int',has_traffic_filtering=True,id=c98bd656-3b1a-4b2d-adb9-026b171ef063,network=Network(8c0bb9a4-c569-427c-b647-0edba62c1127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc98bd656-3b')
Apr 13 18:16:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Deleting instance files /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7_del
Apr 13 18:16:14 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Deletion of /opt/stack/data/nova/instances/b2a75c59-c54c-49ea-908f-ff7856befac7_del complete
Apr 13 18:16:14 user nova-compute[71354]: INFO nova.compute.manager [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 13 18:16:14 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:16:14 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:16:15 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Took 0.74 seconds to deallocate network for instance.
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-c3cd825d-579d-4290-89c1-3d4d6970994e req-a83621c2-1638-4f29-b95d-65bb0d9e27f5 service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-deleted-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Deleted allocations for instance b2a75c59-c54c-49ea-908f-ff7856befac7
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-a7d719a3-f30e-4f26-b7f0-de79b2d32ca5 tempest-VolumesActionsTest-927910348 tempest-VolumesActionsTest-927910348-project-member] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:15 user nova-compute[71354]: WARNING nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state deleted and task_state None.
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:15 user nova-compute[71354]: WARNING nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state deleted and task_state None.
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:15 user nova-compute[71354]: WARNING nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state deleted and task_state None.
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:15 user nova-compute[71354]: WARNING nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-unplugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state deleted and task_state None.
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Acquiring lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] Lock "b2a75c59-c54c-49ea-908f-ff7856befac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:15 user nova-compute[71354]: DEBUG nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] No waiting events found dispatching network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:16:15 user nova-compute[71354]: WARNING nova.compute.manager [req-db1b37db-a440-4f28-b057-baf712a98e4f req-34126b5c-f6ac-4c38-89a9-2ed5501714ca service nova] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Received unexpected event network-vif-plugged-c98bd656-3b1a-4b2d-adb9-026b171ef063 for instance with vm_state deleted and task_state None.
Apr 13 18:16:16 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:23 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:16:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:16:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:16:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:16:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:16:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:16:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:16:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:16:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409774.1888504, b2a75c59-c54c-49ea-908f-ff7856befac7 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:16:29 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] VM Stopped (Lifecycle Event)
Apr 13 18:16:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-05975e8d-1961-454b-9096-2ff536299738 None None] [instance: b2a75c59-c54c-49ea-908f-ff7856befac7] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:16:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-changed-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:16:40 user nova-compute[71354]: DEBUG nova.compute.manager [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Refreshing instance network info cache due to event network-changed-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:16:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Acquiring lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:16:40 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Acquired lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:16:40 user nova-compute[71354]: DEBUG nova.network.neutron [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Refreshing network info cache for port 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:16:41 user nova-compute[71354]: DEBUG nova.network.neutron [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updated VIF entry in instance network info cache for port 9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:16:41 user nova-compute[71354]: DEBUG nova.network.neutron [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:16:41 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-ace7de02-0a04-47e3-bed2-06d4c41a12b1 req-fff301d4-cde0-4c90-b37b-e1745c16efe9 service nova] Releasing lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:16:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:44 user nova-compute[71354]: INFO nova.compute.manager [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Attaching volume 9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 to /dev/vdb
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.utils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b63aa9a-fe90-4036-841c-eacb0815a878]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25d504-634e-4ae6-8579-efe2b59db9ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[50831deb-627f-4a21-8c49-9b068841772b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b9e78-6633-4205-ad04-9f7ac588dfeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:16:44 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:16:44 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe64d68-1fb3-410d-8d83-355fa7d27e89]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG os_brick.utils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:16:44 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating existing volume attachment record: 9aa70717-cec6-4f83-bc29-c687efdc5655 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:16:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIMuSiOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:16:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:16:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:16:49 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dc99ca-32d9-4975-9433-8c872cdeea5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:16:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb49160-c504-4015-a223-92e9caaaa7c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7] added
Apr 13 18:16:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f71e59-1454-44c0-9ec9-d93dd521e9f8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb039528-dab7-4a5a-a0ab-4916c85c9abc]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIMuSiOn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIMuSiOn" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa9866-d44b-48cb-bcf4-fa1a4ad28bd4]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIMuSiOn'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d152036-ce09-4e7a-a2f1-268266a73e58]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad258426-502b-4bbf-acb0-c8002b7ae78c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:16:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:16:49 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:16:49 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 18:16:49 user nova-compute[71354]: 
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422419d-e1d1-424d-92e6-57c0a111500f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260]
Apr 13 18:16:49 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260] successful.
Apr 13 18:16:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef83102-2bcb-457f-867f-9e3159933780]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0a972-822c-46f8-ba4a-de47273c582d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)
Apr 13 18:16:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)
Apr 13 18:16:49 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce920e54-3a53-4fa9-8987-07cb8de8feb8]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:49 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIMuSiOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26166636462356563', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166636462356563', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:16:50 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:16:50 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:16:50 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:16:50 user nova-compute[71354]:   <serial>9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7</serial>
Apr 13 18:16:50 user nova-compute[71354]: </disk>
Apr 13 18:16:50 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] No VIF found with MAC fa:16:3e:27:8f:e3, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:16:50 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ccbc0d0d-0f49-41fb-8241-d9e55eb153f7 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.570s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:16:52 user nova-compute[71354]: INFO nova.compute.manager [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Detaching volume 9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7
Apr 13 18:16:52 user nova-compute[71354]: INFO nova.virt.block_device [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Attempting to driver detach volume 9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 from mountpoint /dev/vdb
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Attempting to detach device vdb from instance 795e0737-96c6-4fea-8806-acab63dca5c1 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:16:52 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:16:52 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:16:52 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:16:52 user nova-compute[71354]:   <serial>9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7</serial>
Apr 13 18:16:52 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:16:52 user nova-compute[71354]: </disk>
Apr 13 18:16:52 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:16:52 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 795e0737-96c6-4fea-8806-acab63dca5c1 from the persistent domain config.
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 795e0737-96c6-4fea-8806-acab63dca5c1 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:16:52 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:16:52 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:16:52 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:16:52 user nova-compute[71354]:   <serial>9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7</serial>
Apr 13 18:16:52 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:16:52 user nova-compute[71354]: </disk>
Apr 13 18:16:52 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681409812.8008888, 795e0737-96c6-4fea-8806-acab63dca5c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:16:52 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully detached device vdb from instance 795e0737-96c6-4fea-8806-acab63dca5c1 from the live domain config.
Apr 13 18:16:52 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIMuSiOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:16:52 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa2089-378a-4909-879e-de8ec5afa4cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:16:52 user nova-compute[71354]: No targets found.
Apr 13 18:16:52 user nova-compute[71354]: iSNS:
Apr 13 18:16:52 user nova-compute[71354]: No targets found.
Apr 13 18:16:52 user nova-compute[71354]: STATIC:
Apr 13 18:16:52 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7
Apr 13 18:16:52 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:16:52 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:16:52 user nova-compute[71354]: FIRMWARE:
Apr 13 18:16:52 user nova-compute[71354]: No targets found.
Apr 13 18:16:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:16:52 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:16:52 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2251561-f9c7-40ed-82f9-63f58bb5eca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f658b-21f6-4ed1-a05f-0a6b68c993e5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)
Apr 13 18:16:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 (non-flash)
Apr 13 18:16:52 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d463d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb9f48-6672-4110-a4a7-4080c41f8231]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c07288-b098-4344-b89b-3d3f2a8d1a50]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b4626-3ccb-4b19-8399-803b01e45365]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:16:52 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[76580524-9fff-4e1f-82a2-261b3fc32713]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7605ae3-655f-4590-99e7-4e1fa1790257]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d10b046-1b24-42eb-a304-1f79f2cdb37c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260]
Apr 13 18:16:53 user nova-compute[71354]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7, portal: 172.16.0.220,3260] successful.
Apr 13 18:16:53 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3f174d-7a4f-40d7-a5da-a7080e5a6bf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[95034dfb-f3e1-4f99-b9cd-3a31e767e22f]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] <== disconnect_volume: return (302ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'flavor' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:16:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0efe05ba-4ddc-491a-85ed-eab77a758174 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:16:54 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:16:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:16:59 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:03 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:05 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:07 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:17:09 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:11 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:17:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:14 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:15 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:17:15 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=26.013492584228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 795e0737-96c6-4fea-8806-acab63dca5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:17:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:19 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:19 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:17:19 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:17:23 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:17:24 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:24 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [{"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:17:24 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-795e0737-96c6-4fea-8806-acab63dca5c1" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:17:24 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:17:29 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:34 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:39 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:39 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:42 user nova-compute[71354]: INFO nova.compute.manager [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Terminating instance
Apr 13 18:17:42 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:42 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-unplugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] No waiting events found dispatching network-vif-unplugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.compute.manager [req-9359f2c9-7f8f-4bd1-b49f-d7c640beacac req-e305cacd-bc85-4394-b503-3648483e6f5d service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-unplugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:17:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Instance destroyed successfully.
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.objects.instance [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lazy-loading 'resources' on Instance uuid 795e0737-96c6-4fea-8806-acab63dca5c1 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:14:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854731271',display_name='tempest-AttachVolumeNegativeTest-server-1854731271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854731271',id=45,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHNju1AA9B90vrvDFy8kmD5AJdCh3GaYjia8Kjy/e5MlIDSLb16RR+R/NvEZ/dLTX9d+CC0afomz07XWjbWwI1ou51yNrVwg6CdbDS3UkcALU2sN/6oDYbdwbwbzb7U3A==',key_name='tempest-keypair-1180586501',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:14:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bfb2b952aa4fd8a66d4eb5aa052e97',ramdisk_id='',reservation_id='r-59e754e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1374126190',owner_user_name='tempest-AttachVolumeNegativeTest-1374126190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ac81be2a2db40b2acbae911db8086ca',uuid=795e0737-96c6-4fea-8806-acab63dca5c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converting VIF {"id": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "address": "fa:16:3e:27:8f:e3", "network": {"id": "182886ee-6e1e-4146-903d-955b8b6726f4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1029399444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5bfb2b952aa4fd8a66d4eb5aa052e97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac6b872-44", "ovs_interfaceid": "9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG os_vif [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ac6b872-44, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:43 user nova-compute[71354]: INFO os_vif [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:8f:e3,bridge_name='br-int',has_traffic_filtering=True,id=9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c,network=Network(182886ee-6e1e-4146-903d-955b8b6726f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac6b872-44')
Apr 13 18:17:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Deleting instance files /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1_del
Apr 13 18:17:43 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Deletion of /opt/stack/data/nova/instances/795e0737-96c6-4fea-8806-acab63dca5c1_del complete
Apr 13 18:17:43 user nova-compute[71354]: INFO nova.compute.manager [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 18:17:43 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:17:43 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:17:44 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Took 0.80 seconds to deallocate network for instance.
Apr 13 18:17:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG nova.compute.manager [req-09a7d7e4-bf1e-4953-a0b4-c69b8b7ffb24 req-8bc8e34b-3ad8-4598-bfaf-00b0163445d3 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-deleted-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:17:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:44 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Deleted allocations for instance 795e0737-96c6-4fea-8806-acab63dca5c1
Apr 13 18:17:44 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-f23c4a89-8e31-44f5-9760-9d4e675bb4b2 tempest-AttachVolumeNegativeTest-1374126190 tempest-AttachVolumeNegativeTest-1374126190-project-member] Lock "795e0737-96c6-4fea-8806-acab63dca5c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.010s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Acquiring lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] Lock "795e0737-96c6-4fea-8806-acab63dca5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG nova.compute.manager [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] No waiting events found dispatching network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:17:45 user nova-compute[71354]: WARNING nova.compute.manager [req-c0bf30f7-c428-4236-b152-45b2dfd457ec req-4757d727-a2bd-4137-a797-362093056da5 service nova] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Received unexpected event network-vif-plugged-9ac6b872-445a-4a8f-a6b3-a38a9d2a8a9c for instance with vm_state deleted and task_state None.
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:45 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:17:45 user nova-compute[71354]: INFO nova.compute.claims [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Claim successful on node user
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:17:46 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.policy [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:17:46 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Creating image(s)
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "/opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "/opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "/opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.144s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk 1073741824" returned: 0 in 0.052s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:17:46 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Successfully created port: b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Cannot resize image /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.objects.instance [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'migration_context' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Ensure instance console log exists: /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Successfully updated port: b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquired lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-changed-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.compute.manager [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Refreshing instance network info cache due to event network-changed-b0c0f448-716a-403a-86fc-863bc8b62206. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Acquiring lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:17:47 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.neutron [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating instance_info_cache with network_info: [{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Releasing lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Instance network_info: |[{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Acquired lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.neutron [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Refreshing network info cache for port b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Start _get_guest_xml network_info=[{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:17:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:17:48 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535986949',display_name='tempest-VolumesSnapshotTestJSON-instance-1535986949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535986949',id=46,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-uhqdiyxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:17:46Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=363170b9-0f09-4d89-9a9d-b1bb6756b384,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.objects.instance [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'pci_devices' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:17:48 user nova-compute[71354]:   <uuid>363170b9-0f09-4d89-9a9d-b1bb6756b384</uuid>
Apr 13 18:17:48 user nova-compute[71354]:   <name>instance-0000002e</name>
Apr 13 18:17:48 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:17:48 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:17:48 user nova-compute[71354]:   <metadata>
Apr 13 18:17:48 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:17:48 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1535986949</nova:name>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:17:48</nova:creationTime>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:17:48 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:17:48 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:owner>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:user uuid="447d3b6af7df4487a0e7113cdab7ee39">tempest-VolumesSnapshotTestJSON-970599831-project-member</nova:user>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:project uuid="04e0d520107b4881bbd5a63f7033010d">tempest-VolumesSnapshotTestJSON-970599831</nova:project>
Apr 13 18:17:48 user nova-compute[71354]:       </nova:owner>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:17:48 user nova-compute[71354]:       <nova:ports>
Apr 13 18:17:48 user nova-compute[71354]:         <nova:port uuid="b0c0f448-716a-403a-86fc-863bc8b62206">
Apr 13 18:17:48 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 18:17:48 user nova-compute[71354]:         </nova:port>
Apr 13 18:17:48 user nova-compute[71354]:       </nova:ports>
Apr 13 18:17:48 user nova-compute[71354]:     </nova:instance>
Apr 13 18:17:48 user nova-compute[71354]:   </metadata>
Apr 13 18:17:48 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:17:48 user nova-compute[71354]:     <system>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="serial">363170b9-0f09-4d89-9a9d-b1bb6756b384</entry>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="uuid">363170b9-0f09-4d89-9a9d-b1bb6756b384</entry>
Apr 13 18:17:48 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:17:48 user nova-compute[71354]:     </system>
Apr 13 18:17:48 user nova-compute[71354]:   </sysinfo>
Apr 13 18:17:48 user nova-compute[71354]:   <os>
Apr 13 18:17:48 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:17:48 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:17:48 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:17:48 user nova-compute[71354]:   </os>
Apr 13 18:17:48 user nova-compute[71354]:   <features>
Apr 13 18:17:48 user nova-compute[71354]:     <acpi/>
Apr 13 18:17:48 user nova-compute[71354]:     <apic/>
Apr 13 18:17:48 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:17:48 user nova-compute[71354]:   </features>
Apr 13 18:17:48 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:17:48 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:17:48 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:17:48 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:17:48 user nova-compute[71354]:   </clock>
Apr 13 18:17:48 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:17:48 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:17:48 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:17:48 user nova-compute[71354]:   </cpu>
Apr 13 18:17:48 user nova-compute[71354]:   <devices>
Apr 13 18:17:48 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:17:48 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:17:48 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk"/>
Apr 13 18:17:48 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:17:48 user nova-compute[71354]:     </disk>
Apr 13 18:17:48 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:17:48 user nova-compute[71354]:       <mac address="fa:16:3e:ee:f7:02"/>
Apr 13 18:17:48 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:17:48 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:17:48 user nova-compute[71354]:       <target dev="tapb0c0f448-71"/>
Apr 13 18:17:48 user nova-compute[71354]:     </interface>
Apr 13 18:17:48 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:17:48 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/console.log" append="off"/>
Apr 13 18:17:48 user nova-compute[71354]:     </serial>
Apr 13 18:17:48 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:17:48 user nova-compute[71354]:     <video>
Apr 13 18:17:48 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:17:48 user nova-compute[71354]:     </video>
Apr 13 18:17:48 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:17:48 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:17:48 user nova-compute[71354]:     </rng>
Apr 13 18:17:48 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:17:48 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:17:48 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:17:48 user nova-compute[71354]:     </memballoon>
Apr 13 18:17:48 user nova-compute[71354]:   </devices>
Apr 13 18:17:48 user nova-compute[71354]: </domain>
Apr 13 18:17:48 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535986949',display_name='tempest-VolumesSnapshotTestJSON-instance-1535986949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535986949',id=46,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-uhqdiyxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:17:46Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=363170b9-0f09-4d89-9a9d-b1bb6756b384,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG os_vif [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0c0f448-71, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0c0f448-71, col_values=(('external_ids', {'iface-id': 'b0c0f448-716a-403a-86fc-863bc8b62206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f7:02', 'vm-uuid': '363170b9-0f09-4d89-9a9d-b1bb6756b384'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:48 user nova-compute[71354]: INFO os_vif [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71')
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No VIF found with MAC fa:16:3e:ee:f7:02, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.neutron [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updated VIF entry in instance network info cache for port b0c0f448-716a-403a-86fc-863bc8b62206. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG nova.network.neutron [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating instance_info_cache with network_info: [{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:17:48 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-51cc986a-719a-4b94-8d68-b53f7161c25f req-7899c6d1-3b95-497e-8763-507e519f9f7a service nova] Releasing lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:49 user nova-compute[71354]: DEBUG nova.compute.manager [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] No waiting events found dispatching network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:17:49 user nova-compute[71354]: WARNING nova.compute.manager [req-9b506a53-a4a7-4119-a878-9a386bcdcc5f req-a7fd5ed5-43a1-4c3a-8f86-71ea9b95f598 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received unexpected event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 for instance with vm_state building and task_state spawning.
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409871.6049838, 363170b9-0f09-4d89-9a9d-b1bb6756b384 => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] VM Resumed (Lifecycle Event)
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Instance spawned successfully.
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681409871.6064112, 363170b9-0f09-4d89-9a9d-b1bb6756b384 => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] VM Started (Lifecycle Event)
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:17:51 user nova-compute[71354]: INFO nova.compute.manager [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Took 5.83 seconds to build instance.
Apr 13 18:17:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-078b0243-7797-4cb5-a15c-89274d094821 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.935s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:17:51 user nova-compute[71354]: DEBUG nova.compute.manager [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] No waiting events found dispatching network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:17:51 user nova-compute[71354]: WARNING nova.compute.manager [req-9fdc6db0-38d9-4c07-ac25-cac78e948855 req-86f292af-f270-48ba-90e9-5fa1246842a7 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received unexpected event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 for instance with vm_state active and task_state None.
Apr 13 18:17:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:17:58 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681409863.442851, 795e0737-96c6-4fea-8806-acab63dca5c1 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:17:58 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] VM Stopped (Lifecycle Event)
Apr 13 18:17:58 user nova-compute[71354]: DEBUG nova.compute.manager [None req-75c787f6-a3a3-4b2f-abd1-ed74ef6f7b76 None None] [instance: 795e0737-96c6-4fea-8806-acab63dca5c1] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:18:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:18:05 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:06 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:18:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:18:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:18:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:18:16 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=26.17144012451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:18:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:18:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:18:25 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:18:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating instance_info_cache with network_info: [{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:18:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:18:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:18:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:18:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:18:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:07 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:10 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:19:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:16 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:19:17 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=26.16136932373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:19:17 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:19:18 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:19 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:19:26 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:19:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating instance_info_cache with network_info: [{"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:19:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-363170b9-0f09-4d89-9a9d-b1bb6756b384" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:19:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:19:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG nova.objects.instance [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:19:36 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Ignoring supplied device name: /dev/vdb
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:19:36 user nova-compute[71354]: INFO nova.compute.manager [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Attaching volume 63fa3a6a-b611-44d6-8aeb-f6c512da4973 to /dev/vdb
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.utils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c4a489-a664-4251-9ec1-0f2d088b1eaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142ae7a-6410-4d22-a9ff-8e7c4a0e7ccc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c72d6-2e4e-438f-9391-78178b3b6d9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa709ec-f920-4c44-87da-6f8e3670c799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:19:36 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:19:36 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e4e35-39ed-4566-b85c-bf5462ba4afd]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG os_brick.utils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:19:36 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating existing volume attachment record: a297bd10-a68b-46ed-89a0-c0202427e789 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:19:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCvaGgwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:19:40 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:19:40 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:19:40 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed396e5-a2b8-4d10-84c6-3230c60237dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:19:40 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b821b2c-b3d9-4de8-bc61-72e699647fc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973] added
Apr 13 18:19:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b4d69-474d-4190-85a2-7738c5baf959]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a57fa32-d181-4fc1-97ce-c80f859dc308]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCvaGgwI {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCvaGgwI" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a0967-5231-422f-808c-6efd51a38da7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iCvaGgwI'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d2a4e4-8383-4737-901c-a13297e4849c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e91fce-e535-4659-bb13-e9dc007ef644]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:19:40 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:19:40 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:19:40 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 18:19:40 user nova-compute[71354]: 
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a187c98-6593-4bb9-a24f-e771141f7ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260]
Apr 13 18:19:40 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260] successful.
Apr 13 18:19:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d3920d-5a27-4f70-91f4-3d7e46125c03]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578d977-e6c8-40ae-9ff5-262ddfe4c792]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)
Apr 13 18:19:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)
Apr 13 18:19:40 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea11ead-66ee-4f5d-bad6-63e39d3e14ba]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:19:40 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCvaGgwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:19:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:19:41 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23734313936626238', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:19:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734313936626238', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:19:41 user nova-compute[71354]: DEBUG nova.objects.instance [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:19:41 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:19:41 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:19:41 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:19:41 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:19:41 user nova-compute[71354]:   <serial>63fa3a6a-b611-44d6-8aeb-f6c512da4973</serial>
Apr 13 18:19:41 user nova-compute[71354]: </disk>
Apr 13 18:19:41 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:19:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:19:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:19:42 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No VIF found with MAC fa:16:3e:ee:f7:02, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:19:42 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-87581bbe-0096-40d0-a23f-6317b754ae08 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.287s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:19:43 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:19:48 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:19:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:19:58 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:02 user nova-compute[71354]: INFO nova.compute.manager [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Detaching volume 63fa3a6a-b611-44d6-8aeb-f6c512da4973
Apr 13 18:20:02 user nova-compute[71354]: INFO nova.virt.block_device [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Attempting to driver detach volume 63fa3a6a-b611-44d6-8aeb-f6c512da4973 from mountpoint /dev/vdb
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Attempting to detach device vdb from instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:20:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:20:02 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:20:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:20:02 user nova-compute[71354]:   <serial>63fa3a6a-b611-44d6-8aeb-f6c512da4973</serial>
Apr 13 18:20:02 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:20:02 user nova-compute[71354]: </disk>
Apr 13 18:20:02 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:20:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully detached device vdb from instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 from the persistent domain config.
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:20:02 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:20:02 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:20:02 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:20:02 user nova-compute[71354]:   <serial>63fa3a6a-b611-44d6-8aeb-f6c512da4973</serial>
Apr 13 18:20:02 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:20:02 user nova-compute[71354]: </disk>
Apr 13 18:20:02 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681410002.9573574, 363170b9-0f09-4d89-9a9d-b1bb6756b384 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:20:02 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully detached device vdb from instance 363170b9-0f09-4d89-9a9d-b1bb6756b384 from the live domain config.
Apr 13 18:20:02 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCvaGgwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:20:02 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334655d-3ac1-4c0e-84a0-d26710950284]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:20:02 user nova-compute[71354]: No targets found.
Apr 13 18:20:02 user nova-compute[71354]: iSNS:
Apr 13 18:20:02 user nova-compute[71354]: No targets found.
Apr 13 18:20:02 user nova-compute[71354]: STATIC:
Apr 13 18:20:02 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973
Apr 13 18:20:02 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:20:02 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:20:02 user nova-compute[71354]: FIRMWARE:
Apr 13 18:20:02 user nova-compute[71354]: No targets found.
Apr 13 18:20:02 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:20:02 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:20:02 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:20:02 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[9095f41d-c3e5-4e8f-b6dd-2849f381a8fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7efb785-670b-4ec3-b637-91939ad9f4f4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)
Apr 13 18:20:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 (non-flash)
Apr 13 18:20:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50b41b0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1724e13-6f90-4ae1-934d-403ce653aeef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02ad8c-ef56-4fec-b2bf-8156e3779b76]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e88f5b-4864-46ef-bd4a-87046d1546d7]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1991f90f-c736-469e-b0e8-386a4c6a37d9]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4022965-9168-48c3-b222-88a671cf773d]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4cc213-2e13-46cb-ade9-3314bdccb4bb]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260]
Apr 13 18:20:03 user nova-compute[71354]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973, portal: 172.16.0.220,3260] successful.
Apr 13 18:20:03 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd578c0-63b4-4805-95bc-1ac864315522]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== disconnect_volume: return (326ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:20:03 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-e0aed3b3-bc09-4beb-97b7-3bdb75986ed9 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.938s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.808s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:04 user nova-compute[71354]: INFO nova.compute.manager [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Terminating instance
Apr 13 18:20:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-unplugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] No waiting events found dispatching network-vif-unplugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:20:04 user nova-compute[71354]: DEBUG nova.compute.manager [req-a616d988-dddf-44d3-9893-c382eb8e850a req-b2a22be2-da42-4204-a3cc-b5304c790cad service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-unplugged-b0c0f448-716a-403a-86fc-863bc8b62206 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Instance destroyed successfully.
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.objects.instance [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'resources' on Instance uuid 363170b9-0f09-4d89-9a9d-b1bb6756b384 {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535986949',display_name='tempest-VolumesSnapshotTestJSON-instance-1535986949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535986949',id=46,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-uhqdiyxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:17:52Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=363170b9-0f09-4d89-9a9d-b1bb6756b384,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "b0c0f448-716a-403a-86fc-863bc8b62206", "address": "fa:16:3e:ee:f7:02", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c0f448-71", "ovs_interfaceid": "b0c0f448-716a-403a-86fc-863bc8b62206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_vif [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0c0f448-71, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:05 user nova-compute[71354]: INFO os_vif [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f7:02,bridge_name='br-int',has_traffic_filtering=True,id=b0c0f448-716a-403a-86fc-863bc8b62206,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c0f448-71')
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:63fa3a6a-b611-44d6-8aeb-f6c512da4973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCvaGgwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:20:05 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[44a705c5-3abf-4bf7-855f-452e91ba59c4]: Unexpected error while running command.
Apr 13 18:20:05 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:20:05 user nova-compute[71354]: Exit code: 21
Apr 13 18:20:05 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:20:05 user nova-compute[71354]: Stderr: '' {{(pid=81468) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 13 18:20:05 user nova-compute[71354]: Traceback (most recent call last):
Apr 13 18:20:05 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 13 18:20:05 user nova-compute[71354]:     ret = func(*f_args, **f_kwargs)
Apr 13 18:20:05 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 13 18:20:05 user nova-compute[71354]:     return func(*args, **kwargs)
Apr 13 18:20:05 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 13 18:20:05 user nova-compute[71354]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 13 18:20:05 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 13 18:20:05 user nova-compute[71354]:     return putils.execute(on_execute=on_execute,
Apr 13 18:20:05 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 13 18:20:05 user nova-compute[71354]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 13 18:20:05 user nova-compute[71354]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:20:05 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:20:05 user nova-compute[71354]: Exit code: 21
Apr 13 18:20:05 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:20:05 user nova-compute[71354]: Stderr: ''
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a705c5-3abf-4bf7-855f-452e91ba59c4]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:20:05 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:20:05 user nova-compute[71354]: Exit code: 21
Apr 13 18:20:05 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:20:05 user nova-compute[71354]: Stderr: ''
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 13 18:20:05 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi 
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71354) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== disconnect_volume: return (52ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Deleting instance files /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384_del
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Deletion of /opt/stack/data/nova/instances/363170b9-0f09-4d89-9a9d-b1bb6756b384_del complete
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.compute.manager [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Took 0.48 seconds to deallocate network for instance.
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-a64515f7-3fd1-4c81-a8ed-6e1206c093ad req-26a020d2-3a3f-4b9f-b9ae-8a0cb653b84b service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-deleted-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:20:05 user nova-compute[71354]: WARNING nova.volume.cinder [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Attachment a297bd10-a68b-46ed-89a0-c0202427e789 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a297bd10-a68b-46ed-89a0-c0202427e789. (HTTP 404) (Request-ID: req-22a42c9b-d7fe-4ea2-8a3e-e4ea1479af2b)
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.compute.manager [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:20:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:05 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Deleted allocations for instance 363170b9-0f09-4d89-9a9d-b1bb6756b384
Apr 13 18:20:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-697afe62-bae4-44e3-8b6c-8645adbae0e3 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:20:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Acquiring lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] Lock "363170b9-0f09-4d89-9a9d-b1bb6756b384-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:06 user nova-compute[71354]: DEBUG nova.compute.manager [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] No waiting events found dispatching network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:20:06 user nova-compute[71354]: WARNING nova.compute.manager [req-7313ff22-9767-4c75-aa1f-fd269d5c3110 req-8587410c-d6ae-464a-af88-b9cb67771915 service nova] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Received unexpected event network-vif-plugged-b0c0f448-716a-403a-86fc-863bc8b62206 for instance with vm_state deleted and task_state None.
Apr 13 18:20:08 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:12 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:12 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:20:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:17 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:20:18 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:20:18 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:20:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=26.176288604736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:20:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:20:19 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:20:19 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:20:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:20:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:20:20 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681410005.0771103, 363170b9-0f09-4d89-9a9d-b1bb6756b384 => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:20:20 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] VM Stopped (Lifecycle Event)
Apr 13 18:20:20 user nova-compute[71354]: DEBUG nova.compute.manager [None req-0bdff80f-2ad6-43d6-854d-c2cac2e7bdcd None None] [instance: 363170b9-0f09-4d89-9a9d-b1bb6756b384] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:20:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:27 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:20:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:20:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:20:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:20:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:20:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Starting instance... {{(pid=71354) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71354) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:21:03 user nova-compute[71354]: INFO nova.compute.claims [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Claim successful on node user
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Start building networks asynchronously for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Allocating IP information in the background. {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] allocate_for_instance() {{(pid=71354) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:21:03 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:21:03 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Start building block device mappings for instance. {{(pid=71354) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.policy [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '447d3b6af7df4487a0e7113cdab7ee39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0d520107b4881bbd5a63f7033010d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71354) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Start spawning the instance on the hypervisor. {{(pid=71354) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Creating instance directory {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:21:04 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Creating image(s)
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "/opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "/opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "/opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.132s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk 1073741824 {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7,backing_fmt=raw /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk 1073741824" returned: 0 in 0.055s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "5bccaf6b79ea4de7e178172c57d4a8422dc732c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7 --force-share --output=json" returned: 0 in 0.139s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk. size=1073741824 {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.virt.disk.api [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Cannot resize image /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk to a smaller size. {{(pid=71354) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.objects.instance [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'migration_context' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Created local disks {{(pid=71354) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Ensure instance console log exists: /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/console.log {{(pid=71354) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:04 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Successfully created port: 3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Successfully updated port: 3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquired lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Building network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-changed-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.compute.manager [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Refreshing instance network info cache due to event network-changed-3f54d3e0-5d25-41a4-9302-0c9e782c8332. {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Acquiring lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Instance cache missing network info. {{(pid=71354) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.network.neutron [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating instance_info_cache with network_info: [{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Releasing lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Instance network_info: |[{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71354) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Acquired lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.network.neutron [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Refreshing network info cache for port 3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Start _get_guest_xml network_info=[{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'c7f9966b-afb1-42f9-9999-e623e0bf219a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:21:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:21:05 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71354) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T17:43:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:42:07Z,direct_url=<?>,disk_format='qcow2',id=c7f9966b-afb1-42f9-9999-e623e0bf219a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='43c59a7049124424abda63ea885430c6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:42:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image limits 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flavor pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Image pref 0:0:0 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Got 1 possible topologies {{(pid=71354) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:21:05 user nova-compute[71354]: DEBUG nova.virt.hardware [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71354) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-568204729',display_name='tempest-VolumesSnapshotTestJSON-instance-568204729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-568204729',id=47,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-3vhg4vnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:21:04Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=309a07e3-3f72-4bc9-a199-432d422570ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71354) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.objects.instance [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'pci_devices' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:21:06 user nova-compute[71354]:   <uuid>309a07e3-3f72-4bc9-a199-432d422570ff</uuid>
Apr 13 18:21:06 user nova-compute[71354]:   <name>instance-0000002f</name>
Apr 13 18:21:06 user nova-compute[71354]:   <memory>131072</memory>
Apr 13 18:21:06 user nova-compute[71354]:   <vcpu>1</vcpu>
Apr 13 18:21:06 user nova-compute[71354]:   <metadata>
Apr 13 18:21:06 user nova-compute[71354]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:21:06 user nova-compute[71354]:       <nova:package version="0.0.0"/>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-568204729</nova:name>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:creationTime>2023-04-13 18:21:05</nova:creationTime>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:flavor name="m1.nano">
Apr 13 18:21:06 user nova-compute[71354]:         <nova:memory>128</nova:memory>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:disk>1</nova:disk>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:swap>0</nova:swap>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:21:06 user nova-compute[71354]:       </nova:flavor>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:owner>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:user uuid="447d3b6af7df4487a0e7113cdab7ee39">tempest-VolumesSnapshotTestJSON-970599831-project-member</nova:user>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:project uuid="04e0d520107b4881bbd5a63f7033010d">tempest-VolumesSnapshotTestJSON-970599831</nova:project>
Apr 13 18:21:06 user nova-compute[71354]:       </nova:owner>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:root type="image" uuid="c7f9966b-afb1-42f9-9999-e623e0bf219a"/>
Apr 13 18:21:06 user nova-compute[71354]:       <nova:ports>
Apr 13 18:21:06 user nova-compute[71354]:         <nova:port uuid="3f54d3e0-5d25-41a4-9302-0c9e782c8332">
Apr 13 18:21:06 user nova-compute[71354]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 18:21:06 user nova-compute[71354]:         </nova:port>
Apr 13 18:21:06 user nova-compute[71354]:       </nova:ports>
Apr 13 18:21:06 user nova-compute[71354]:     </nova:instance>
Apr 13 18:21:06 user nova-compute[71354]:   </metadata>
Apr 13 18:21:06 user nova-compute[71354]:   <sysinfo type="smbios">
Apr 13 18:21:06 user nova-compute[71354]:     <system>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="version">0.0.0</entry>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="serial">309a07e3-3f72-4bc9-a199-432d422570ff</entry>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="uuid">309a07e3-3f72-4bc9-a199-432d422570ff</entry>
Apr 13 18:21:06 user nova-compute[71354]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:21:06 user nova-compute[71354]:     </system>
Apr 13 18:21:06 user nova-compute[71354]:   </sysinfo>
Apr 13 18:21:06 user nova-compute[71354]:   <os>
Apr 13 18:21:06 user nova-compute[71354]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:21:06 user nova-compute[71354]:     <boot dev="hd"/>
Apr 13 18:21:06 user nova-compute[71354]:     <smbios mode="sysinfo"/>
Apr 13 18:21:06 user nova-compute[71354]:   </os>
Apr 13 18:21:06 user nova-compute[71354]:   <features>
Apr 13 18:21:06 user nova-compute[71354]:     <acpi/>
Apr 13 18:21:06 user nova-compute[71354]:     <apic/>
Apr 13 18:21:06 user nova-compute[71354]:     <vmcoreinfo/>
Apr 13 18:21:06 user nova-compute[71354]:   </features>
Apr 13 18:21:06 user nova-compute[71354]:   <clock offset="utc">
Apr 13 18:21:06 user nova-compute[71354]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:21:06 user nova-compute[71354]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:21:06 user nova-compute[71354]:     <timer name="hpet" present="no"/>
Apr 13 18:21:06 user nova-compute[71354]:   </clock>
Apr 13 18:21:06 user nova-compute[71354]:   <cpu mode="custom" match="exact">
Apr 13 18:21:06 user nova-compute[71354]:     <model>Nehalem</model>
Apr 13 18:21:06 user nova-compute[71354]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:21:06 user nova-compute[71354]:   </cpu>
Apr 13 18:21:06 user nova-compute[71354]:   <devices>
Apr 13 18:21:06 user nova-compute[71354]:     <disk type="file" device="disk">
Apr 13 18:21:06 user nova-compute[71354]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:21:06 user nova-compute[71354]:       <source file="/opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk"/>
Apr 13 18:21:06 user nova-compute[71354]:       <target dev="vda" bus="virtio"/>
Apr 13 18:21:06 user nova-compute[71354]:     </disk>
Apr 13 18:21:06 user nova-compute[71354]:     <interface type="ethernet">
Apr 13 18:21:06 user nova-compute[71354]:       <mac address="fa:16:3e:ac:b4:ec"/>
Apr 13 18:21:06 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:21:06 user nova-compute[71354]:       <mtu size="1442"/>
Apr 13 18:21:06 user nova-compute[71354]:       <target dev="tap3f54d3e0-5d"/>
Apr 13 18:21:06 user nova-compute[71354]:     </interface>
Apr 13 18:21:06 user nova-compute[71354]:     <serial type="pty">
Apr 13 18:21:06 user nova-compute[71354]:       <log file="/opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/console.log" append="off"/>
Apr 13 18:21:06 user nova-compute[71354]:     </serial>
Apr 13 18:21:06 user nova-compute[71354]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:21:06 user nova-compute[71354]:     <video>
Apr 13 18:21:06 user nova-compute[71354]:       <model type="virtio"/>
Apr 13 18:21:06 user nova-compute[71354]:     </video>
Apr 13 18:21:06 user nova-compute[71354]:     <rng model="virtio">
Apr 13 18:21:06 user nova-compute[71354]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:21:06 user nova-compute[71354]:     </rng>
Apr 13 18:21:06 user nova-compute[71354]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:21:06 user nova-compute[71354]:     <memballoon model="virtio">
Apr 13 18:21:06 user nova-compute[71354]:       <stats period="10"/>
Apr 13 18:21:06 user nova-compute[71354]:     </memballoon>
Apr 13 18:21:06 user nova-compute[71354]:   </devices>
Apr 13 18:21:06 user nova-compute[71354]: </domain>
Apr 13 18:21:06 user nova-compute[71354]:  {{(pid=71354) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-568204729',display_name='tempest-VolumesSnapshotTestJSON-instance-568204729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-568204729',id=47,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-3vhg4vnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:21:04Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=309a07e3-3f72-4bc9-a199-432d422570ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG os_vif [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d') {{(pid=71354) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f54d3e0-5d, may_exist=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f54d3e0-5d, col_values=(('external_ids', {'iface-id': '3f54d3e0-5d25-41a4-9302-0c9e782c8332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:b4:ec', 'vm-uuid': '309a07e3-3f72-4bc9-a199-432d422570ff'}),)) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:06 user nova-compute[71354]: INFO os_vif [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d')
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No VIF found with MAC fa:16:3e:ac:b4:ec, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updated VIF entry in instance network info cache for port 3f54d3e0-5d25-41a4-9302-0c9e782c8332. {{(pid=71354) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG nova.network.neutron [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating instance_info_cache with network_info: [{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:21:06 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-a09f3885-19c6-402d-a8e1-2c0e981f0971 req-29162cd7-23ca-482a-a3c7-15bd92651857 service nova] Releasing lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:07 user nova-compute[71354]: DEBUG nova.compute.manager [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] No waiting events found dispatching network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:21:07 user nova-compute[71354]: WARNING nova.compute.manager [req-cf8c163d-2c1d-47b7-8c33-3c59ac72d700 req-1b1878cf-bc77-4ac2-bcaa-23ab7c4e6794 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received unexpected event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance with vm_state building and task_state spawning.
Apr 13 18:21:07 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:08 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681410069.6527817, 309a07e3-3f72-4bc9-a199-432d422570ff => Resumed> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] VM Resumed (Lifecycle Event)
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Instance event wait completed in 0 seconds for  {{(pid=71354) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Guest created on hypervisor {{(pid=71354) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Instance spawned successfully.
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_cdrom_bus of ide {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_disk_bus of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_input_bus of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_pointer_model of None {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_video_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Found default for hw_vif_model of virtio {{(pid=71354) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.virt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Emitting event <LifecycleEvent: 1681410069.654102, 309a07e3-3f72-4bc9-a199-432d422570ff => Started> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] VM Started (Lifecycle Event)
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71354) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] No waiting events found dispatching network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:21:09 user nova-compute[71354]: WARNING nova.compute.manager [req-e752ef60-059b-4a25-8466-2f6eca7a74df req-375d5bb7-11fc-4462-8b0f-6a0238fe23e4 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received unexpected event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance with vm_state building and task_state spawning.
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Took 5.71 seconds to spawn the instance on the hypervisor.
Apr 13 18:21:09 user nova-compute[71354]: DEBUG nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:21:09 user nova-compute[71354]: INFO nova.compute.manager [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Took 6.22 seconds to build instance.
Apr 13 18:21:09 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-99c75e0f-9b76-49a8-b706-6aea00e1fc64 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.308s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:21:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:19 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:21:19 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=26.17428970336914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 309a07e3-3f72-4bc9-a199-432d422570ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:21:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:20 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:20 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:21:26 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:21:27 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating instance_info_cache with network_info: [{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:21:27 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:21:27 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:21:28 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Verify base images {{(pid=71354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Image id c7f9966b-afb1-42f9-9999-e623e0bf219a yields fingerprint 5bccaf6b79ea4de7e178172c57d4a8422dc732c7 {{(pid=71354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] image c7f9966b-afb1-42f9-9999-e623e0bf219a at (/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7): checking
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] image c7f9966b-afb1-42f9-9999-e623e0bf219a at (/opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7): image is in use {{(pid=71354) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] 309a07e3-3f72-4bc9-a199-432d422570ff is a valid instance name {{(pid=71354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] 309a07e3-3f72-4bc9-a199-432d422570ff has a disk file {{(pid=71354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 309a07e3-3f72-4bc9-a199-432d422570ff is backed by 5bccaf6b79ea4de7e178172c57d4a8422dc732c7 {{(pid=71354) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9
Apr 13 18:21:38 user nova-compute[71354]: WARNING nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Active base files: /opt/stack/data/nova/instances/_base/5bccaf6b79ea4de7e178172c57d4a8422dc732c7
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Removable base files: /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9 /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3 /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9 /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ecd2e28c59ae7670cdd3ebf1f158da736ca92aa9
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7072e7ac849018b6c2092f5ad283dabcb62397bd
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e09bdd5f1985efca81d5ce686a78a49a241f3cc3
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f6a8d6f0a5bfdf729fdaaadeb18637577773c89a
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ab2d607f670d658af2f3cbf626cf70a8d787256c
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa82955b54d88cc4ae8b09969406e4b2fcd73c4f
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/61d2e6b3c15d38b8201df117c27593fe0d931e1c
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c0ed91817b85e3241810d9b810a765592622ef9
Apr 13 18:21:38 user nova-compute[71354]: INFO nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cbfdf7211ae48b9917f30439bbdf813f53dea53f
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Verification complete {{(pid=71354) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Verify swap images {{(pid=71354) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 18:21:38 user nova-compute[71354]: DEBUG nova.virt.libvirt.imagecache [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Verify ephemeral images {{(pid=71354) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 18:21:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:21:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:53 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:21:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:09 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:14 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:15 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:22:16 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:18 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:19 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:22:19 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=26.155345916748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Instance 309a07e3-3f72-4bc9-a199-432d422570ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71354) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:22:19 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:22:21 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] There are 0 instances to clean {{(pid=71354) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:22:23 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:25 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:25 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71354) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:22:26 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquired lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Forcefully refreshing network info cache for instance {{(pid=71354) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:22:28 user nova-compute[71354]: DEBUG nova.objects.instance [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lazy-loading 'info_cache' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:22:29 user nova-compute[71354]: DEBUG nova.network.neutron [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating instance_info_cache with network_info: [{"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:22:29 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Releasing lock "refresh_cache-309a07e3-3f72-4bc9-a199-432d422570ff" {{(pid=71354) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:22:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updated the network info_cache for instance {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:22:31 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:36 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:41 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:46 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:46 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:22:51 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:22:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:22:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:22:53 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:22:53 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Ignoring supplied device name: /dev/vdb
Apr 13 18:22:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:22:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:22:53 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:22:53 user nova-compute[71354]: INFO nova.compute.manager [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Attaching volume 024614e3-a5de-41f7-949b-e543fe681678 to /dev/vdb
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.utils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[55384b19-346a-46c8-a588-5d23dd679e70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:fbbaa2bbdba\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[f176e9b1-5fac-4386-a12b-6cc20b918dc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68401b-0cb6-40fe-abeb-2ab9e933136c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762f281-7719-4475-b062-4503071520bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Running cmd (subprocess): nvme version {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71354) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] nvme not present on system {{(pid=71354) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:22:54 user nova-compute[71354]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:22:54 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[345bc4fc-e1c1-4adf-9edf-8957e01f0e0e]: (4, '') {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71354) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.lightos [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] LIGHTOS: no hostnqn found. {{(pid=71354) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG os_brick.utils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:fbbaa2bbdba', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:22:54 user nova-compute[71354]: DEBUG nova.virt.block_device [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating existing volume attachment record: 2fb757db-6fca-4a54-a4fb-d0bf4bb10720 {{(pid=71354) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:22:56 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Calling os-brick to attach iSCSI Volume {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUgEFOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:22:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:22:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:22:58 user nova-compute[71354]: INFO os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f1e486-f364-4707-a5e6-4b391c824d35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:22:58 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --interface default --op new {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b701bb-6087-442b-94ec-743b2d2d0e9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678] added\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678] added
Apr 13 18:22:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a73c45-1867-4f37-a52c-5fc07d7b4c01]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1841eede-8831-4fe1-84c2-f34bc5a90fa8]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUgEFOq {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUgEFOq" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a01ba-3e55-416c-ac8d-ba023f6bce63]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDUgEFOq'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef5b78-d5e9-4cac-8f39-90b4aeafcc0c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d833e58-dd12-4aef-82d5-61ed4fa24a3e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:22:58 user nova-compute[71354]:  {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:22:58 user nova-compute[71354]:  {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:22:58 user nova-compute[71354]: WARNING os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 18:22:58 user nova-compute[71354]: 
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --login {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4fe37-c638-40e0-a8fb-27715c1f0d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260]
Apr 13 18:22:58 user nova-compute[71354]: Login to [iface: default, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260] successful.
Apr 13 18:22:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb6acb-08d0-4e87-9da2-209d441c617c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b227b9a-bf3f-4cf7-bc52-91fed5629e3e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)
Apr 13 18:22:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)
Apr 13 18:22:58 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Connected to 172.16.0.220:3260 {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71354) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71354) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecca647-c65c-4171-8b73-bc7c66960dad]: (4, ('- - 0', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71354) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:22:58 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUgEFOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71354) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:22:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:22:59 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26333303966326233', 'path': '/dev/sdb'} {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:22:59 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333303966326233', 'path': '/dev/sdb'} {{(pid=71354) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:22:59 user nova-compute[71354]: DEBUG nova.objects.instance [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:23:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:23:00 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:23:00 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:23:00 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:23:00 user nova-compute[71354]:   <serial>024614e3-a5de-41f7-949b-e543fe681678</serial>
Apr 13 18:23:00 user nova-compute[71354]: </disk>
Apr 13 18:23:00 user nova-compute[71354]:  {{(pid=71354) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:23:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:23:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71354) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:23:00 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] No VIF found with MAC fa:16:3e:ac:b4:ec, not building metadata {{(pid=71354) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:23:00 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-ae33e919-cca1-4f3c-952c-c06d2be35403 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.613s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:01 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:06 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:10 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:11 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:12 user nova-compute[71354]: INFO nova.compute.manager [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Detaching volume 024614e3-a5de-41f7-949b-e543fe681678
Apr 13 18:23:12 user nova-compute[71354]: INFO nova.virt.block_device [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Attempting to driver detach volume 024614e3-a5de-41f7-949b-e543fe681678 from mountpoint /dev/vdb
Apr 13 18:23:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Attempting to detach device vdb from instance 309a07e3-3f72-4bc9-a199-432d422570ff from the persistent domain config. {{(pid=71354) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:23:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:23:12 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:23:12 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:23:12 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:23:12 user nova-compute[71354]:   <serial>024614e3-a5de-41f7-949b-e543fe681678</serial>
Apr 13 18:23:12 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:23:12 user nova-compute[71354]: </disk>
Apr 13 18:23:12 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:23:12 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully detached device vdb from instance 309a07e3-3f72-4bc9-a199-432d422570ff from the persistent domain config.
Apr 13 18:23:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 309a07e3-3f72-4bc9-a199-432d422570ff from the live domain config. {{(pid=71354) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:23:12 user nova-compute[71354]: DEBUG nova.virt.libvirt.guest [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:23:12 user nova-compute[71354]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:23:12 user nova-compute[71354]:   <source dev="/dev/sdb"/>
Apr 13 18:23:12 user nova-compute[71354]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:23:12 user nova-compute[71354]:   <serial>024614e3-a5de-41f7-949b-e543fe681678</serial>
Apr 13 18:23:12 user nova-compute[71354]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:23:12 user nova-compute[71354]: </disk>
Apr 13 18:23:12 user nova-compute[71354]:  {{(pid=71354) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:23:12 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-f973fabe-9ff4-400c-bcbe-c443492e0eac None None] Received event <DeviceRemovedEvent: 1681410193.3657782, 309a07e3-3f72-4bc9-a199-432d422570ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71354) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.driver [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:23:13 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully detached device vdb from instance 309a07e3-3f72-4bc9-a199-432d422570ff from the live domain config.
Apr 13 18:23:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUgEFOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:23:13 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f34767d-c680-44fb-924b-acdd44da0f93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:23:13 user nova-compute[71354]: No targets found.
Apr 13 18:23:13 user nova-compute[71354]: iSNS:
Apr 13 18:23:13 user nova-compute[71354]: No targets found.
Apr 13 18:23:13 user nova-compute[71354]: STATIC:
Apr 13 18:23:13 user nova-compute[71354]: Target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678
Apr 13 18:23:13 user nova-compute[71354]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:23:13 user nova-compute[71354]:                 Iface Name: default
Apr 13 18:23:13 user nova-compute[71354]: FIRMWARE:
Apr 13 18:23:13 user nova-compute[71354]: No targets found.
Apr 13 18:23:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:23:13 user nova-compute[71354]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:23:13 user nova-compute[71354]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71354) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678', 0)] {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec352b-d0e4-4f65-94b5-aca75722cb6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c91810-a02a-4888-993e-701a90fb9c78]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)
Apr 13 18:23:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 (non-flash)
Apr 13 18:23:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50d7392560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678'): ({'sdb'}, set())}) {{(pid=71354) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Removing single pathed devices sdb {{(pid=71354) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[957068a7-5abf-4e1f-b03e-c9aa7c303934]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d385c275-8b4a-4711-9331-cac86234d6f2]: (4, ('ok\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Flushing IO for device /dev/sdb {{(pid=71354) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c917c-1489-492b-9223-3bedc66b47ba]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71354) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[3056b2ff-a887-44df-98c7-b4e17c5ed1d1]: (4, ('1', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.linuxscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] SCSI volumes sdb have been removed. {{(pid=71354) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678')] {{(pid=71354) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2506168-f568-4daf-a498-72be5597838c]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --logout {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3f76a-95d0-4217-ac83-4c2f1f4d8915]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260]
Apr 13 18:23:13 user nova-compute[71354]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678, portal: 172.16.0.220,3260] successful.
Apr 13 18:23:13 user nova-compute[71354]:  stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op delete {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d8b302-2ee3-4e21-85d4-e1705a7d8700]: (4, ('', '')) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71354) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== disconnect_volume: return (275ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Triggering sync for uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 18:23:13 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG nova.objects.instance [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'flavor' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-0857ab5a-d7d0-4acf-85d9-f993ba38df06 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.526s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:14 user nova-compute[71354]: INFO nova.compute.manager [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Terminating instance
Apr 13 18:23:14 user nova-compute[71354]: DEBUG nova.compute.manager [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Start destroying the instance on the hypervisor. {{(pid=71354) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-unplugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] No waiting events found dispatching network-vif-unplugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG nova.compute.manager [req-50ad903b-ec9c-4bac-b6d2-0f86fa7fedf9 req-ffa26c7f-8991-4fdf-bd05-25d4dabac606 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-unplugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance with task_state deleting. {{(pid=71354) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:23:14 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Instance destroyed successfully.
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.objects.instance [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lazy-loading 'resources' on Instance uuid 309a07e3-3f72-4bc9-a199-432d422570ff {{(pid=71354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.vif [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-568204729',display_name='tempest-VolumesSnapshotTestJSON-instance-568204729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-568204729',id=47,image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e0d520107b4881bbd5a63f7033010d',ramdisk_id='',reservation_id='r-3vhg4vnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f9966b-afb1-42f9-9999-e623e0bf219a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-970599831',owner_user_name='tempest-VolumesSnapshotTestJSON-970599831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:21:10Z,user_data=None,user_id='447d3b6af7df4487a0e7113cdab7ee39',uuid=309a07e3-3f72-4bc9-a199-432d422570ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converting VIF {"id": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "address": "fa:16:3e:ac:b4:ec", "network": {"id": "c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1671974990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "04e0d520107b4881bbd5a63f7033010d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54d3e0-5d", "ovs_interfaceid": "3f54d3e0-5d25-41a4-9302-0c9e782c8332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.network.os_vif_util [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d') {{(pid=71354) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_vif [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d') {{(pid=71354) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f54d3e0-5d, bridge=br-int, if_exists=True) {{(pid=71354) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:15 user nova-compute[71354]: INFO os_vif [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:b4:ec,bridge_name='br-int',has_traffic_filtering=True,id=3f54d3e0-5d25-41a4-9302-0c9e782c8332,network=Network(c2e2b38f-65f3-4fba-b9fb-79082ed2f0e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54d3e0-5d')
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] calling os-brick to detach iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f50d424d2a0>, {'target_iqn': 'iqn.2010-10.org.openstack:024614e3-a5de-41f7-949b-e543fe681678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUgEFOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:23:15 user nova-compute[71354]: WARNING os_brick.initiator.connectors.base [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81468) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0faa245d-1cda-4635-93ad-1a31e9c607df]: Unexpected error while running command.
Apr 13 18:23:15 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:23:15 user nova-compute[71354]: Exit code: 21
Apr 13 18:23:15 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:23:15 user nova-compute[71354]: Stderr: '' {{(pid=81468) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 13 18:23:15 user nova-compute[71354]: Traceback (most recent call last):
Apr 13 18:23:15 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 13 18:23:15 user nova-compute[71354]:     ret = func(*f_args, **f_kwargs)
Apr 13 18:23:15 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 13 18:23:15 user nova-compute[71354]:     return func(*args, **kwargs)
Apr 13 18:23:15 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 13 18:23:15 user nova-compute[71354]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 13 18:23:15 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 13 18:23:15 user nova-compute[71354]:     return putils.execute(on_execute=on_execute,
Apr 13 18:23:15 user nova-compute[71354]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 13 18:23:15 user nova-compute[71354]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 13 18:23:15 user nova-compute[71354]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:23:15 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:23:15 user nova-compute[71354]: Exit code: 21
Apr 13 18:23:15 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:23:15 user nova-compute[71354]: Stderr: ''
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa245d-1cda-4635-93ad-1a31e9c607df]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81468) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:23:15 user nova-compute[71354]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:23:15 user nova-compute[71354]: Exit code: 21
Apr 13 18:23:15 user nova-compute[71354]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:23:15 user nova-compute[71354]: Stderr: ''
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 13 18:23:15 user nova-compute[71354]: ERROR os_brick.initiator.connectors.iscsi 
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71354) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.base [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG os_brick.initiator.connectors.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] <== disconnect_volume: return (27ms) None {{(pid=71354) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Disconnected iSCSI Volume {{(pid=71354) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Deleting instance files /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff_del
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.virt.libvirt.driver [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Deletion of /opt/stack/data/nova/instances/309a07e3-3f72-4bc9-a199-432d422570ff_del complete
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.compute.manager [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo.service.loopingcall [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71354) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.compute.manager [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Deallocating network for instance {{(pid=71354) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] deallocate_for_instance() {{(pid=71354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG nova.network.neutron [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Updating instance_info_cache with network_info: [] {{(pid=71354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Took 0.48 seconds to deallocate network for instance.
Apr 13 18:23:15 user nova-compute[71354]: WARNING nova.volume.cinder [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Attachment 2fb757db-6fca-4a54-a4fb-d0bf4bb10720 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2fb757db-6fca-4a54-a4fb-d0bf4bb10720. (HTTP 404) (Request-ID: req-ca205204-c315-4d45-9e75-6c9cb8e5e4da)
Apr 13 18:23:15 user nova-compute[71354]: INFO nova.compute.manager [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:15 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:16 user nova-compute[71354]: INFO nova.scheduler.client.report [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Deleted allocations for instance 309a07e3-3f72-4bc9-a199-432d422570ff
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-89375a7a-79c0-449f-801f-0ff1bc58cf29 tempest-VolumesSnapshotTestJSON-970599831 tempest-VolumesSnapshotTestJSON-970599831-project-member] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.428s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:16 user nova-compute[71354]: INFO nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "309a07e3-3f72-4bc9-a199-432d422570ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Acquiring lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] Lock "309a07e3-3f72-4bc9-a199-432d422570ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] No waiting events found dispatching network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:23:16 user nova-compute[71354]: WARNING nova.compute.manager [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received unexpected event network-vif-plugged-3f54d3e0-5d25-41a4-9302-0c9e782c8332 for instance with vm_state deleted and task_state None.
Apr 13 18:23:16 user nova-compute[71354]: DEBUG nova.compute.manager [req-4a0ab10e-ca59-4733-893c-74ce1a6725e5 req-c4f8de39-3e3f-41b2-bc65-05f083b93137 service nova] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Received event network-vif-deleted-3f54d3e0-5d25-41a4-9302-0c9e782c8332 {{(pid=71354) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:23:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:23:20 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:23:20 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=26.17263412475586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:23:20 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing inventories for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating ProviderTree inventory for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Updating inventory in ProviderTree for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing aggregate associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, aggregates: None {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Refreshing trait associations for resource provider 5ba64940-f5e9-4512-be6b-2626ffa78506, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71354) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:23:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:23:22 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:23 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:29 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:23:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:23:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:23:29 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681410195.212553, 309a07e3-3f72-4bc9-a199-432d422570ff => Stopped> {{(pid=71354) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:23:30 user nova-compute[71354]: INFO nova.compute.manager [-] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] VM Stopped (Lifecycle Event)
Apr 13 18:23:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-9f1e8f4b-0b3d-4a96-a3f3-20f7cd50ae6a None None] [instance: 309a07e3-3f72-4bc9-a199-432d422570ff] Checking state {{(pid=71354) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:23:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:00 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:05 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:10 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:11 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:13 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:15 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:16 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:17 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:17 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71354) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:20 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=71354) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:24:21 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:24:21 user nova-compute[71354]: WARNING nova.virt.libvirt.driver [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:24:21 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=26.171398162841797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71354) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:24:21 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71354) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG nova.compute.provider_tree [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed in ProviderTree for provider: 5ba64940-f5e9-4512-be6b-2626ffa78506 {{(pid=71354) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG nova.scheduler.client.report [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Inventory has not changed for provider 5ba64940-f5e9-4512-be6b-2626ffa78506 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71354) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG nova.compute.resource_tracker [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Compute_service record updated for user:user {{(pid=71354) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:24:22 user nova-compute[71354]: DEBUG oslo_concurrency.lockutils [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=71354) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:24:24 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:24 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:25 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG oslo_service.periodic_task [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71354) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Starting heal instance info cache {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Rebuilding the list of instances to heal {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:24:30 user nova-compute[71354]: DEBUG nova.compute.manager [None req-7cfee5dc-5de1-4b3d-901b-c369a7d2fef1 None None] Didn't find any instances for network info cache update. {{(pid=71354) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:24:32 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:33 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:35 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:40 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:45 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71354) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71354) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:24:50 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:24:55 user nova-compute[71354]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71354) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}